Jul 23 18:02:20.385320 ip-10-0-134-130 systemd[1]: Starting Kubernetes Kubelet... Jul 23 18:02:20.811730 ip-10-0-134-130 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:02:20.811730 ip-10-0-134-130 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 18:02:20.811730 ip-10-0-134-130 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:02:20.811730 ip-10-0-134-130 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 18:02:20.811730 ip-10-0-134-130 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:02:20.813490 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.813404 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 18:02:20.818318 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818302 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:02:20.818318 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818318 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818322 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818325 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818328 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818331 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818334 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818338 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818340 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818344 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818347 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818350 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818352 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818355 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818357 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818360 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818363 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818366 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818368 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818371 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818373 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:02:20.818377 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818375 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818378 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818381 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818384 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818386 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818389 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818392 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818394 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818397 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818399 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818402 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818404 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818406 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818409 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818411 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818414 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818416 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818419 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818422 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818424 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:02:20.818843 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818427 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818429 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818432 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818434 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818436 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818439 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818441 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818444 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818446 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818448 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818451 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818453 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818456 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818459 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818463 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818465 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818468 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818470 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818473 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818475 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:02:20.819366 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818480 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818483 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818486 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818489 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818492 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818495 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818497 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818501 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818504 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818508 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818510 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818519 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818522 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818526 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818529 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818532 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818535 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818538 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818540 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:02:20.819852 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818543 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818545 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818548 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818550 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818553 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818556 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818558 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818561 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818564 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818566 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818569 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818571 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818574 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818576 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818578 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818581 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818585 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818588 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.818591 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:02:20.820332 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819310 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819319 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819324 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819327 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819330 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819333 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819337 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819340 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819342 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819345 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819347 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819350 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819353 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819355 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819358 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819360 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819363 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819365 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819368 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:02:20.820782 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819372 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819374 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819377 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819379 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819382 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819385 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819387 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819390 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819392 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819395 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819397 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819399 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819402 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819404 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819407 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819409 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819413 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819415 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819418 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819420 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:02:20.821268 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819423 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819426 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819428 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819430 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819433 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819435 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819438 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819440 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819443 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819445 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819448 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819450 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819453 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819455 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819458 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819460 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819463 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819466 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819468 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819472 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:02:20.821766 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819475 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819477 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819479 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819481 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819484 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819487 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819489 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819491 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819495 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819499 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819502 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819504 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819506 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819509 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819512 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819516 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819518 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819521 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819524 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:02:20.822298 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819526 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819530 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819533 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819536 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819539 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819541 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819544 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819547 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819549 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819551 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819554 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819557 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819559 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819562 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819564 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819567 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819569 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819572 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819574 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819577 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:02:20.822761 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819579 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819940 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819945 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819948 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819951 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819954 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819957 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819959 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819962 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819965 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819968 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819970 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819973 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819975 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819978 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819982 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819986 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819989 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819991 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:02:20.823250 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819994 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819996 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.819999 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820001 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820004 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820006 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820009 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820012 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820014 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820017 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820020 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820037 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820040 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820042 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820046 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820050 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820053 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820055 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820058 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:02:20.823707 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820060 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820064 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820066 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820071 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820073 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820076 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820078 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820081 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820084 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820086 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820089 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820091 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820094 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820096 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820099 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820101 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820104 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820106 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820108 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820111 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:02:20.824173 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820114 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820116 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820119 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820121 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820124 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820126 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820128 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820131 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820134 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820136 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820139 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820141 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820144 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820146 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820149 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820154 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820157 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820159 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820162 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820164 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:02:20.824639 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820167 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820169 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820174 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820178 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820181 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820184 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820187 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820189 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820192 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820195 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820197 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820200 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820203 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820205 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820208 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820210 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820212 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820215 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820217 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820220 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:02:20.825236 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820222 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820224 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820297 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820304 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820314 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820321 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820327 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820334 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820339 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820343 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820346 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820349 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820352 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820356 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820360 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820363 2580 flags.go:64] FLAG: --cgroup-root="" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820366 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820369 2580 flags.go:64] FLAG: --client-ca-file="" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820371 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820374 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820378 2580 flags.go:64] FLAG: --cluster-domain="" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820399 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820410 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820414 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 18:02:20.825722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820418 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820423 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820426 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820430 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820433 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820437 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820440 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820442 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820445 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820448 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820452 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820455 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820458 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820461 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820464 2580 flags.go:64] FLAG: --enable-server="true" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820467 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820474 2580 flags.go:64] FLAG: --event-burst="100" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820477 2580 flags.go:64] FLAG: --event-qps="50" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820480 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820484 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820487 2580 flags.go:64] FLAG: --eviction-hard="" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820491 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820494 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820497 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820500 2580 flags.go:64] FLAG: --eviction-soft="" Jul 23 18:02:20.826308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820502 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820506 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820508 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820511 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820515 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820518 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820521 2580 flags.go:64] FLAG: --feature-gates="" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820524 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820528 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820531 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820534 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820537 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820540 2580 flags.go:64] FLAG: --help="false" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820543 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-134-130.ec2.internal" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820546 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820549 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820552 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820556 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820560 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820563 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820566 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820568 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820571 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 18:02:20.826916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820574 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820577 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820582 2580 flags.go:64] FLAG: --kube-reserved="" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820585 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820588 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820591 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820594 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820597 2580 flags.go:64] FLAG: --lock-file="" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820600 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820603 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820606 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820612 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820614 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820618 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820621 2580 flags.go:64] FLAG: --logging-format="text" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820624 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820627 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820630 2580 flags.go:64] FLAG: --manifest-url="" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820632 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820637 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820640 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820645 2580 flags.go:64] FLAG: --max-pods="110" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820648 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820651 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820653 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 18:02:20.827534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820656 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820659 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820662 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820664 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820671 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820674 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820677 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820680 2580 flags.go:64] FLAG: --pod-cidr="" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820683 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820688 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820692 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820694 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820697 2580 flags.go:64] FLAG: --port="10250" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820701 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820704 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061bdf1c96d2d905e" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820707 2580 flags.go:64] FLAG: --qos-reserved="" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820710 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820713 2580 flags.go:64] FLAG: --register-node="true" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820716 2580 flags.go:64] FLAG: --register-with-taints="" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820720 2580 flags.go:64] FLAG: --registry-burst="10" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820724 2580 flags.go:64] FLAG: --registry-qps="5" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820727 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820730 2580 flags.go:64] FLAG: --reserved-memory="" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820734 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820737 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 18:02:20.828459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820739 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820742 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820745 2580 flags.go:64] FLAG: --runonce="false" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820748 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820751 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820754 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820756 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820759 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820763 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820765 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820768 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820771 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820774 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820777 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820780 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820783 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820786 2580 flags.go:64] FLAG: --system-cgroups="" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820791 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820797 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820800 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820802 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820807 2580 flags.go:64] FLAG: --tls-min-version="" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820810 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820812 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820815 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 18:02:20.829207 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820818 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820821 2580 flags.go:64] FLAG: --v="2" Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820829 2580 flags.go:64] FLAG: --version="false" Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820833 2580 flags.go:64] FLAG: --vmodule="" Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820843 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.820846 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820967 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820971 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820974 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820977 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820979 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820981 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820984 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820987 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820989 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820992 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820994 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820997 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.820999 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821002 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821005 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:02:20.829832 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821007 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821010 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821012 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821016 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821018 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821040 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821046 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821049 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821052 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821055 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821058 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821060 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821063 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821067 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821069 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821072 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821075 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821077 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821080 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821082 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:02:20.830362 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821085 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821087 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821090 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821092 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821094 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821097 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821099 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821103 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821107 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821109 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821112 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821115 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821117 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821120 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821122 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821125 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821128 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821130 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821133 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:02:20.830847 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821135 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821138 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821140 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821143 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821145 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821148 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821151 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821154 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821156 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821159 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821162 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821164 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821167 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821169 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821172 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821174 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821177 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821179 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821182 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821184 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:02:20.831328 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821187 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821189 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821192 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821194 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821197 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821199 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821201 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821204 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821207 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821209 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821213 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821217 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821220 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821222 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821225 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821227 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821230 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821232 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821237 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:02:20.831849 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821239 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821241 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821244 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821246 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821248 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.821251 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.821888 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.830060 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.830077 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.830915 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.830923 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.830983 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.830988 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.830992 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:02:20.832329 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.830996 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831000 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831003 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831006 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831009 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831012 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831015 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831018 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831020 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831041 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831044 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831046 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831049 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831051 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831054 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831057 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831060 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831062 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831065 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831074 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:02:20.832683 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831076 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831079 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831081 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831084 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831086 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831089 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831092 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831095 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831098 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831100 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831103 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831123 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831127 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831130 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831133 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831136 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831139 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831141 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831144 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831146 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:02:20.833195 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831149 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831151 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831154 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831156 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831159 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831161 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831164 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831166 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831169 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831171 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831174 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831177 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831179 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831182 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831185 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831187 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831189 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831192 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831195 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831198 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:02:20.833689 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831200 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831203 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831205 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831208 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831211 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831213 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831215 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831218 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831221 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831223 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831225 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831228 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831230 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831233 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831235 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831237 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831240 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831243 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831246 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831250 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:02:20.834184 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831254 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831257 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831259 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831262 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831264 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831268 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831271 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831274 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831277 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831279 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831283 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831286 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831289 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831291 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831294 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:02:20.834656 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831297 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.831302 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831414 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831420 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831423 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831426 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831429 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831431 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831434 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831437 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831439 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831442 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831444 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831447 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831450 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:02:20.835074 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831453 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831456 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831458 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831461 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831463 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831467 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831471 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831475 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831477 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831480 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831482 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831485 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831488 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831490 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831493 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831496 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831498 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831501 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831503 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:02:20.835444 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831505 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831508 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831510 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831512 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831515 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831518 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831521 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831524 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831526 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831529 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831531 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831534 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831536 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831539 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831541 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831544 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831546 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831550 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831553 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:02:20.835892 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831556 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831559 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831561 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831564 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831567 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831570 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831573 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831576 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831578 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831581 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831584 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831586 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831589 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831591 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831593 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831596 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831598 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831601 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831603 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831605 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:02:20.836356 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831608 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831611 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831613 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831616 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831618 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831620 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831623 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831626 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831629 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831631 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831633 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831636 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831639 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831641 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831643 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831646 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831649 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831651 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831654 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831656 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:02:20.836827 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831658 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831661 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831663 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831665 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831668 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831671 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831673 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:20.831675 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.831680 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.831789 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.833767 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.835158 2580 server.go:1019] "Starting client certificate rotation" Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.835255 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:02:20.837319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.835297 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:02:20.837701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.837688 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:02:20.841930 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.841912 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:02:20.850659 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.850639 2580 log.go:25] "Validated CRI v1 runtime API" Jul 23 18:02:20.852653 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.852639 2580 log.go:25] "Validated CRI v1 image API" Jul 23 18:02:20.853460 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.853442 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 18:02:20.856379 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.856360 2580 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ad1c391c-de1c-4f6e-b9b4-e285251c3001:/dev/nvme0n1p4 b96f60b7-de31-4238-9add-7a58db4c8187:/dev/nvme0n1p3] Jul 23 18:02:20.856429 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.856379 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 18:02:20.863105 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.862954 2580 manager.go:216] Machine: {Timestamp:2026-07-23 18:02:20.86113605 +0000 UTC m=+0.355952858 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100598 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ac60ae5452117e5f4230bc6ba7279 SystemUUID:ec2ac60a-e545-2117-e5f4-230bc6ba7279 BootID:a7e5cbdc-0dc0-48cf-aef0-2f0673dc517e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:5e:4d:02:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:5e:4d:02:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:d0:0a:cc:a4:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 18:02:20.863105 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.863091 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 18:02:20.863256 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.863170 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 18:02:20.865771 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.865747 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:02:20.866868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.866844 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 18:02:20.867000 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.866872 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-130.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 18:02:20.868131 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.868120 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 18:02:20.868168 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.868134 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 18:02:20.868168 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.868141 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:02:20.868663 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.868653 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:02:20.869910 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.869900 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 18:02:20.872617 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.872606 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:02:20.872742 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.872733 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 18:02:20.872775 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.872763 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 23 18:02:20.872775 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.872773 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 18:02:20.872829 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.872784 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 18:02:20.872829 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.872793 2580 kubelet.go:398] "Adding apiserver pod source" Jul 23 18:02:20.872829 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.872802 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 18:02:20.873193 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.873179 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:02:20.873244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.873204 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:02:20.875644 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.875624 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 18:02:20.878556 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.878541 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 18:02:20.878602 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.878574 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 18:02:20.879571 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879559 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 18:02:20.879604 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879576 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 18:02:20.879604 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879583 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 18:02:20.879604 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879588 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 18:02:20.879604 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879597 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 18:02:20.879716 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879613 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 18:02:20.879716 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879621 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 18:02:20.879716 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879626 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 18:02:20.879716 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879632 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 18:02:20.879716 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879638 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 18:02:20.879716 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879645 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 18:02:20.879716 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.879650 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 18:02:20.881157 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.881143 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 18:02:20.881201 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.881170 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 18:02:20.882216 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.882183 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 18:02:20.882284 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.882233 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 18:02:20.884595 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.884581 2580 server.go:1268] "Started kubelet" Jul 23 18:02:20.884741 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.884661 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 18:02:20.884741 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.884653 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 18:02:20.884858 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.884742 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 18:02:20.885447 ip-10-0-134-130 systemd[1]: Started Kubernetes Kubelet. Jul 23 18:02:20.886290 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.886276 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 18:02:20.887597 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.887584 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 23 18:02:20.891268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.891251 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljr98" Jul 23 18:02:20.891819 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.891804 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 18:02:20.892377 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.892362 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-130.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 18:02:20.893316 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.892365 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-130.ec2.internal.18c4fd3161f9dd02 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-130.ec2.internal,UID:ip-10-0-134-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-130.ec2.internal,},FirstTimestamp:2026-07-23 18:02:20.884548866 +0000 UTC m=+0.379365674,LastTimestamp:2026-07-23 18:02:20.884548866 +0000 UTC m=+0.379365674,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-130.ec2.internal,}" Jul 23 18:02:20.893863 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.893848 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 18:02:20.893918 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.893851 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 18:02:20.894087 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.894064 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:20.894481 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.894460 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 18:02:20.894481 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.894463 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 18:02:20.894600 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.894488 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 18:02:20.894661 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.894648 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 23 18:02:20.894696 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.894662 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 23 18:02:20.894828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.894807 2580 factory.go:55] Registering systemd factory Jul 23 18:02:20.894913 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.894860 2580 factory.go:223] Registration of the systemd container factory successfully Jul 23 18:02:20.895149 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.895135 2580 factory.go:153] Registering CRI-O factory Jul 23 18:02:20.895149 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.895151 2580 factory.go:223] Registration of the crio container factory successfully Jul 23 18:02:20.895249 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.895198 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 18:02:20.895249 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.895217 2580 factory.go:103] Registering Raw factory Jul 23 18:02:20.895249 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.895239 2580 manager.go:1196] Started watching for new ooms in manager Jul 23 18:02:20.895835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.895817 2580 manager.go:349] Starting recovery of all containers Jul 23 18:02:20.897877 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.897845 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 18:02:20.897957 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.897915 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljr98" Jul 23 18:02:20.898007 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.897980 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 18:02:20.907668 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.907647 2580 manager.go:354] Recovery completed Jul 23 18:02:20.912448 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.912432 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:02:20.916661 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.916644 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:02:20.916727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.916674 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:02:20.916727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.916684 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:02:20.917289 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.917269 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 18:02:20.917289 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.917285 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:02:20.917443 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.917286 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 18:02:20.917443 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.917336 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:02:20.918079 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.918064 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:02:20.918127 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.918097 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:02:20.918127 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.918111 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:02:20.918533 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.918518 2580 policy_none.go:49] "None policy: Start" Jul 23 18:02:20.918587 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.918539 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 18:02:20.918587 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.918549 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 18:02:20.918817 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.918748 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-130.ec2.internal.18c4fd3163e3dad6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-130.ec2.internal,UID:ip-10-0-134-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-130.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-130.ec2.internal,},FirstTimestamp:2026-07-23 18:02:20.91666095 +0000 UTC m=+0.411477758,LastTimestamp:2026-07-23 18:02:20.91666095 +0000 UTC m=+0.411477758,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-130.ec2.internal,}" Jul 23 18:02:20.919475 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.919464 2580 policy_none.go:47] "Start" Jul 23 18:02:20.952075 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.951862 2580 manager.go:337] "Starting Device Plugin manager" Jul 23 18:02:20.952185 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.952119 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 18:02:20.952185 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.952132 2580 server.go:87] "Starting device plugin registration server" Jul 23 18:02:20.952361 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.952351 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 18:02:20.952391 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.952371 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 18:02:20.952490 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.952468 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 18:02:20.952593 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.952552 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 18:02:20.952593 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:20.952561 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 18:02:20.953200 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.953177 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 18:02:20.953287 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:20.953236 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.000656 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.000625 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 18:02:21.001971 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.001943 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 18:02:21.002076 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.001996 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 18:02:21.002076 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.002066 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 18:02:21.002175 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.002112 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 18:02:21.004599 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.004578 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:02:21.052968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.052935 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:02:21.053947 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.053925 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:02:21.054060 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.053965 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:02:21.054060 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.053976 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:02:21.054060 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.053998 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.064386 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.064344 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.064386 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.064370 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-130.ec2.internal\": node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.080531 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.080508 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.102255 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.102213 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal"] Jul 23 18:02:21.102325 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.102300 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:02:21.103788 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.103774 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:02:21.103866 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.103800 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:02:21.103866 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.103809 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:02:21.105003 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.104991 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:02:21.105131 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105117 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.105168 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105149 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:02:21.105720 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105703 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:02:21.105788 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105732 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:02:21.105788 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105746 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:02:21.105788 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105764 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:02:21.105919 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105788 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:02:21.105919 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.105802 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:02:21.106988 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.106975 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.107063 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.107001 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:02:21.107658 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.107642 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:02:21.107707 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.107673 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:02:21.107707 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.107686 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:02:21.146167 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.146138 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-130.ec2.internal\" not found" node="ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.150953 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.150933 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-130.ec2.internal\" not found" node="ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.181117 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.181094 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.196015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.195991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94312c955e17d448c2c7c3aefbb15c00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal\" (UID: \"94312c955e17d448c2c7c3aefbb15c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.196149 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.196041 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94312c955e17d448c2c7c3aefbb15c00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal\" (UID: \"94312c955e17d448c2c7c3aefbb15c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.196149 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.196070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68a6a4a068480f33d4378a102cee2ec2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-130.ec2.internal\" (UID: \"68a6a4a068480f33d4378a102cee2ec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.282096 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.282069 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.296461 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.296438 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94312c955e17d448c2c7c3aefbb15c00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal\" (UID: \"94312c955e17d448c2c7c3aefbb15c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.296513 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.296476 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94312c955e17d448c2c7c3aefbb15c00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal\" (UID: \"94312c955e17d448c2c7c3aefbb15c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.296513 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.296494 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68a6a4a068480f33d4378a102cee2ec2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-130.ec2.internal\" (UID: \"68a6a4a068480f33d4378a102cee2ec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.296583 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.296531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/94312c955e17d448c2c7c3aefbb15c00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal\" (UID: \"94312c955e17d448c2c7c3aefbb15c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.296583 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.296552 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68a6a4a068480f33d4378a102cee2ec2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-130.ec2.internal\" (UID: \"68a6a4a068480f33d4378a102cee2ec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.296583 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.296557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/94312c955e17d448c2c7c3aefbb15c00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal\" (UID: \"94312c955e17d448c2c7c3aefbb15c00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.382925 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.382851 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.449346 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.449316 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.454277 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.453583 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.483993 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.483956 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.584467 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.584433 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.684982 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.684923 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-130.ec2.internal\" not found" Jul 23 18:02:21.738170 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.738145 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:02:21.794266 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.794240 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.819409 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.819390 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:02:21.821300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.821286 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" Jul 23 18:02:21.833401 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.833375 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:02:21.834432 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.834417 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 18:02:21.834536 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.834518 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:02:21.834582 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.834518 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:02:21.873757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.873739 2580 apiserver.go:52] "Watching apiserver" Jul 23 18:02:21.894178 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.894152 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 18:02:21.894846 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.894825 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 18:02:21.895185 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.895154 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-cpzsh","openshift-network-diagnostics/network-check-target-hn6bs","kube-system/global-pull-secret-syncer-z8kbh","kube-system/konnectivity-agent-qv67x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz","openshift-dns/node-resolver-h9w27","openshift-image-registry/node-ca-mllq9","openshift-multus/multus-hkb6v","openshift-network-operator/iptables-alerter-x26h8","openshift-ovn-kubernetes/ovnkube-node-pwvxd","kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal","openshift-cluster-node-tuning-operator/tuned-ggzls","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal","openshift-multus/multus-additional-cni-plugins-5msvc"] Jul 23 18:02:21.896699 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.896678 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:21.898935 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.898917 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.899382 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.899356 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 18:02:21.899465 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.899383 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5l8qc\"" Jul 23 18:02:21.899891 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.899873 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 18:02:21.899968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.899935 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 18:02:21.900042 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.900008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:21.900107 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.900087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:21.900933 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.900918 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:21.902272 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.902257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:21.903480 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.903462 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:21.904740 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.904725 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:21.904830 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.904749 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2dtxg\"" Jul 23 18:02:21.904830 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.904793 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-chwbz\"" Jul 23 18:02:21.904971 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.904793 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 18:02:21.904971 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.904797 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 18:02:21.905198 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.905184 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 18:02:21.905291 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.905275 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 18:02:21.905384 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.905343 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zvmtx\"" Jul 23 18:02:21.906176 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.905954 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:21.906176 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.905989 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 18:02:21.906176 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.906001 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 18:02:21.906176 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.906012 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:21.906176 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.906051 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 18:02:21.906477 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.906317 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 18:02:21.906477 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.906375 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 18:02:21.906477 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.906471 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 18:02:21.907236 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.907220 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:21.907324 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:21.907281 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:21.907665 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.907463 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9zv88\"" Jul 23 18:02:21.907665 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.907469 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 18:02:21.907665 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.907477 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 18:02:21.907665 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.907477 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gcpcl\"" Jul 23 18:02:21.907665 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.907569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:02:21.908604 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.908588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.908700 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.908627 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 17:57:22 +0000 UTC" deadline="2028-03-15 02:28:50.140423137 +0000 UTC" Jul 23 18:02:21.908700 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.908651 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14408h26m28.231775391s" Jul 23 18:02:21.909856 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.909838 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.911017 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.910756 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:02:21.911100 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911047 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.911374 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911188 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 18:02:21.911448 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911417 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5864v\"" Jul 23 18:02:21.911547 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911525 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 18:02:21.911585 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911568 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 18:02:21.911814 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911794 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 18:02:21.911904 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911829 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 18:02:21.911964 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911943 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 18:02:21.911964 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.911958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 18:02:21.912585 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.912564 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 18:02:21.912652 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.912586 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c6rhp\"" Jul 23 18:02:21.913006 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.912994 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 18:02:21.913938 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.913921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:02:21.914048 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.913942 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-k8xqv\"" Jul 23 18:02:21.914048 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.913927 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 18:02:21.932932 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.932907 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-568mx" Jul 23 18:02:21.941657 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.941598 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-568mx" Jul 23 18:02:21.948616 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.948596 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:02:21.970704 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:21.970676 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94312c955e17d448c2c7c3aefbb15c00.slice/crio-4abd03758bd7ff507107132e3773ade03136f74d127378088340c29fafda7af0 WatchSource:0}: Error finding container 4abd03758bd7ff507107132e3773ade03136f74d127378088340c29fafda7af0: Status 404 returned error can't find the container with id 4abd03758bd7ff507107132e3773ade03136f74d127378088340c29fafda7af0 Jul 23 18:02:21.970985 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:21.970958 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a6a4a068480f33d4378a102cee2ec2.slice/crio-9736a61d575244b7a6cb34e83785748fa4d33ae4f5bcdcce80654d6cb9ba6bd3 WatchSource:0}: Error finding container 9736a61d575244b7a6cb34e83785748fa4d33ae4f5bcdcce80654d6cb9ba6bd3: Status 404 returned error can't find the container with id 9736a61d575244b7a6cb34e83785748fa4d33ae4f5bcdcce80654d6cb9ba6bd3 Jul 23 18:02:21.974916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.974898 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:02:21.995860 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.995846 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 18:02:21.998764 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998743 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-run\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.998823 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-host-slash\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:21.998823 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998802 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.998924 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998851 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.998924 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998887 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvtth\" (UniqueName: \"kubernetes.io/projected/81524e11-cb7e-4cac-9d67-33901e97c2a9-kube-api-access-nvtth\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.998924 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysconfig\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999095 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998938 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-cni-bin\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999095 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998965 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-system-cni-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.999095 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.998987 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-os-release\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.999095 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-slash\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999095 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999055 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-var-lib-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999095 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999080 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-socket-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999100 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-sys\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-cni-bin\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999148 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-daemon-config\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999172 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-ovn\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96hqf\" (UniqueName: \"kubernetes.io/projected/0436d67e-a04b-4c43-9909-9b48d218b69d-kube-api-access-96hqf\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999219 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999244 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs9st\" (UniqueName: \"kubernetes.io/projected/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-kube-api-access-hs9st\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999270 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-system-cni-dir\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-var-lib-kubelet\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999337 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hlmj\" (UniqueName: \"kubernetes.io/projected/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-kube-api-access-6hlmj\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999372 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999359 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5045a998-463e-4b12-90f1-6a4588f4d439-serviceca\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfgfg\" (UniqueName: \"kubernetes.io/projected/e81f35da-d51e-4529-91b4-dfcaa96a8901-kube-api-access-jfgfg\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999406 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999428 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-kubernetes\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999449 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e50dae0-9d85-4d18-ba7b-4b75564028fb-cni-binary-copy\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-cni-netd\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-cnibin\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999515 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-systemd\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-tmp\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999568 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-socket-dir-parent\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999617 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-systemd\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0436d67e-a04b-4c43-9909-9b48d218b69d-ovn-node-metrics-cert\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-os-release\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-host\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-netns\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:21.999968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmhkh\" (UniqueName: \"kubernetes.io/projected/5e50dae0-9d85-4d18-ba7b-4b75564028fb-kube-api-access-vmhkh\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999757 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-run-netns\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-sys-fs\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97e7e893-89fd-455e-8475-0a13f62ee46c-kubelet-config\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/375bc743-21ff-4900-9b71-15c6aa813039-tmp-dir\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999867 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a615b62f-62de-45c8-9bf1-db84109bf36a-konnectivity-ca\") pod \"konnectivity-agent-qv67x\" (UID: \"a615b62f-62de-45c8-9bf1-db84109bf36a\") " pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-registration-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999935 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysctl-d\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:21.999982 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-kubelet\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-etc-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000056 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-ovnkube-config\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000081 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-k8s-cni-cncf-io\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000102 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/375bc743-21ff-4900-9b71-15c6aa813039-hosts-file\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000124 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-systemd-units\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.000704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-device-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-tuned\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000190 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-env-overrides\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-ovnkube-script-lib\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000237 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a615b62f-62de-45c8-9bf1-db84109bf36a-agent-certs\") pod \"konnectivity-agent-qv67x\" (UID: \"a615b62f-62de-45c8-9bf1-db84109bf36a\") " pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysctl-conf\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000305 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv7gp\" (UniqueName: \"kubernetes.io/projected/5045a998-463e-4b12-90f1-6a4588f4d439-kube-api-access-nv7gp\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000341 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-cnibin\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000364 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-cni-multus\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000394 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-etc-kubernetes\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-iptables-alerter-script\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-multus-certs\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97e7e893-89fd-455e-8475-0a13f62ee46c-dbus\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000504 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-node-log\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000559 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5045a998-463e-4b12-90f1-6a4588f4d439-host\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.001189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000598 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-cni-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wpkw\" (UniqueName: \"kubernetes.io/projected/375bc743-21ff-4900-9b71-15c6aa813039-kube-api-access-2wpkw\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000646 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-log-socket\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-modprobe-d\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-conf-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-kubelet\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000741 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000779 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-lib-modules\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000809 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-hostroot\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000836 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dczjm\" (UniqueName: \"kubernetes.io/projected/0ddc8e8b-0447-4544-9a4f-94582ab04012-kube-api-access-dczjm\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:22.001670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.000862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-etc-selinux\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.005112 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.005069 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" event={"ID":"68a6a4a068480f33d4378a102cee2ec2","Type":"ContainerStarted","Data":"9736a61d575244b7a6cb34e83785748fa4d33ae4f5bcdcce80654d6cb9ba6bd3"} Jul 23 18:02:22.006036 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.006005 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" event={"ID":"94312c955e17d448c2c7c3aefbb15c00","Type":"ContainerStarted","Data":"4abd03758bd7ff507107132e3773ade03136f74d127378088340c29fafda7af0"} Jul 23 18:02:22.076350 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.076322 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:02:22.102118 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102087 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-lib-modules\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.102118 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-hostroot\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102137 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dczjm\" (UniqueName: \"kubernetes.io/projected/0ddc8e8b-0447-4544-9a4f-94582ab04012-kube-api-access-dczjm\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-etc-selinux\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-run\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102223 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-hostroot\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102293 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-run\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102290 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-lib-modules\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102290 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-etc-selinux\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-host-slash\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102350 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.102359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102353 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-host-slash\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvtth\" (UniqueName: \"kubernetes.io/projected/81524e11-cb7e-4cac-9d67-33901e97c2a9-kube-api-access-nvtth\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102439 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysconfig\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102461 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-cni-bin\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102482 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-system-cni-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-os-release\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102507 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysconfig\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102517 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-slash\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102569 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-slash\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102575 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-system-cni-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102581 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-var-lib-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102581 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-os-release\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-cni-bin\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102616 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-var-lib-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102626 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-socket-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-sys\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.102769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-cni-bin\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102700 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-daemon-config\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102723 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-ovn\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102736 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-sys\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102737 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-cni-bin\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96hqf\" (UniqueName: \"kubernetes.io/projected/0436d67e-a04b-4c43-9909-9b48d218b69d-kube-api-access-96hqf\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102754 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-socket-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102781 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102795 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-ovn\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102834 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs9st\" (UniqueName: \"kubernetes.io/projected/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-kube-api-access-hs9st\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-system-cni-dir\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102897 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-system-cni-dir\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102942 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-var-lib-kubelet\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.102947 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.102966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hlmj\" (UniqueName: \"kubernetes.io/projected/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-kube-api-access-6hlmj\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5045a998-463e-4b12-90f1-6a4588f4d439-serviceca\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.103549 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.103045 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret podName:97e7e893-89fd-455e-8475-0a13f62ee46c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.603003746 +0000 UTC m=+2.097820545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret") pod "global-pull-secret-syncer-z8kbh" (UID: "97e7e893-89fd-455e-8475-0a13f62ee46c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103049 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-var-lib-kubelet\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfgfg\" (UniqueName: \"kubernetes.io/projected/e81f35da-d51e-4529-91b4-dfcaa96a8901-kube-api-access-jfgfg\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103185 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-kubernetes\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e50dae0-9d85-4d18-ba7b-4b75564028fb-cni-binary-copy\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-cni-netd\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103253 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-cnibin\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103276 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-systemd\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.103282 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103298 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-tmp\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103320 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-cni-netd\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.103328 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs podName:0ddc8e8b-0447-4544-9a4f-94582ab04012 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.60331278 +0000 UTC m=+2.098129577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs") pod "network-metrics-daemon-cpzsh" (UID: "0ddc8e8b-0447-4544-9a4f-94582ab04012") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103344 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-daemon-config\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103363 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-socket-dir-parent\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103390 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:22.104423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103408 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-systemd\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103417 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-systemd\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-cnibin\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103456 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0436d67e-a04b-4c43-9909-9b48d218b69d-ovn-node-metrics-cert\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103467 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-systemd\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103471 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103484 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-os-release\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103411 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-socket-dir-parent\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103509 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-host\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-netns\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103559 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmhkh\" (UniqueName: \"kubernetes.io/projected/5e50dae0-9d85-4d18-ba7b-4b75564028fb-kube-api-access-vmhkh\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-host\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103571 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/81524e11-cb7e-4cac-9d67-33901e97c2a9-os-release\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5045a998-463e-4b12-90f1-6a4588f4d439-serviceca\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-kubernetes\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103584 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-run-netns\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103609 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-netns\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.105537 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-sys-fs\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103681 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97e7e893-89fd-455e-8475-0a13f62ee46c-kubelet-config\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103685 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-run-netns\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-sys-fs\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103711 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/375bc743-21ff-4900-9b71-15c6aa813039-tmp-dir\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103738 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/97e7e893-89fd-455e-8475-0a13f62ee46c-kubelet-config\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a615b62f-62de-45c8-9bf1-db84109bf36a-konnectivity-ca\") pod \"konnectivity-agent-qv67x\" (UID: \"a615b62f-62de-45c8-9bf1-db84109bf36a\") " pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103780 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-run-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103786 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-registration-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103808 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysctl-d\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103860 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-kubelet\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103869 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e50dae0-9d85-4d18-ba7b-4b75564028fb-cni-binary-copy\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103884 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-etc-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103886 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-registration-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103927 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-ovnkube-config\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.106636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103949 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-kubelet\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103952 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-k8s-cni-cncf-io\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/375bc743-21ff-4900-9b71-15c6aa813039-hosts-file\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.103988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-k8s-cni-cncf-io\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104002 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/375bc743-21ff-4900-9b71-15c6aa813039-tmp-dir\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104042 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-etc-openvswitch\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104056 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/375bc743-21ff-4900-9b71-15c6aa813039-hosts-file\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104072 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-systemd-units\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-device-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-tuned\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-env-overrides\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104170 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysctl-d\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104182 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-ovnkube-script-lib\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104221 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-device-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104315 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a615b62f-62de-45c8-9bf1-db84109bf36a-agent-certs\") pod \"konnectivity-agent-qv67x\" (UID: \"a615b62f-62de-45c8-9bf1-db84109bf36a\") " pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104336 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104355 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysctl-conf\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.107466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv7gp\" (UniqueName: \"kubernetes.io/projected/5045a998-463e-4b12-90f1-6a4588f4d439-kube-api-access-nv7gp\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104378 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/81524e11-cb7e-4cac-9d67-33901e97c2a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-cnibin\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104424 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-cni-multus\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104445 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a615b62f-62de-45c8-9bf1-db84109bf36a-konnectivity-ca\") pod \"konnectivity-agent-qv67x\" (UID: \"a615b62f-62de-45c8-9bf1-db84109bf36a\") " pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-etc-kubernetes\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104455 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-systemd-units\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104530 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-var-lib-cni-multus\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104428 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-cnibin\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104550 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-sysctl-conf\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104572 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-ovnkube-config\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104454 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-etc-kubernetes\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104668 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-ovnkube-script-lib\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104802 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-iptables-alerter-script\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104828 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-multus-certs\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97e7e893-89fd-455e-8475-0a13f62ee46c-dbus\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104965 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-node-log\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.104987 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105010 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5045a998-463e-4b12-90f1-6a4588f4d439-host\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105049 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-cni-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wpkw\" (UniqueName: \"kubernetes.io/projected/375bc743-21ff-4900-9b71-15c6aa813039-kube-api-access-2wpkw\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105096 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-log-socket\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-modprobe-d\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-conf-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-kubelet\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105190 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105272 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105319 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-iptables-alerter-script\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105343 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0436d67e-a04b-4c43-9909-9b48d218b69d-env-overrides\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105383 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-host-run-multus-certs\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105383 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/97e7e893-89fd-455e-8475-0a13f62ee46c-dbus\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105438 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-node-log\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105443 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-kubelet\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105456 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5045a998-463e-4b12-90f1-6a4588f4d439-host\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105494 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-log-socket\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105500 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0436d67e-a04b-4c43-9909-9b48d218b69d-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105512 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-modprobe-d\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105550 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-cni-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e81f35da-d51e-4529-91b4-dfcaa96a8901-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.105686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e50dae0-9d85-4d18-ba7b-4b75564028fb-multus-conf-dir\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.107217 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-etc-tuned\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.107279 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-tmp\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.107304 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0436d67e-a04b-4c43-9909-9b48d218b69d-ovn-node-metrics-cert\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.108981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.107511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a615b62f-62de-45c8-9bf1-db84109bf36a-agent-certs\") pod \"konnectivity-agent-qv67x\" (UID: \"a615b62f-62de-45c8-9bf1-db84109bf36a\") " pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:22.115861 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.115840 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvtth\" (UniqueName: \"kubernetes.io/projected/81524e11-cb7e-4cac-9d67-33901e97c2a9-kube-api-access-nvtth\") pod \"multus-additional-cni-plugins-5msvc\" (UID: \"81524e11-cb7e-4cac-9d67-33901e97c2a9\") " pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.115966 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.115923 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:02:22.115966 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.115941 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:02:22.115966 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.115953 2580 projected.go:196] Error preparing data for projected volume kube-api-access-vjtlk for pod openshift-network-diagnostics/network-check-target-hn6bs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:22.116152 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.116004 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk podName:bb63282e-081b-448c-9d99-44973804abd5 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:22.615991665 +0000 UTC m=+2.110808460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vjtlk" (UniqueName: "kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk") pod "network-check-target-hn6bs" (UID: "bb63282e-081b-448c-9d99-44973804abd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:22.116880 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.116837 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-96hqf\" (UniqueName: \"kubernetes.io/projected/0436d67e-a04b-4c43-9909-9b48d218b69d-kube-api-access-96hqf\") pod \"ovnkube-node-pwvxd\" (UID: \"0436d67e-a04b-4c43-9909-9b48d218b69d\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.118518 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.118485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv7gp\" (UniqueName: \"kubernetes.io/projected/5045a998-463e-4b12-90f1-6a4588f4d439-kube-api-access-nv7gp\") pod \"node-ca-mllq9\" (UID: \"5045a998-463e-4b12-90f1-6a4588f4d439\") " pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.118628 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.118608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dczjm\" (UniqueName: \"kubernetes.io/projected/0ddc8e8b-0447-4544-9a4f-94582ab04012-kube-api-access-dczjm\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:22.118889 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.118867 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmhkh\" (UniqueName: \"kubernetes.io/projected/5e50dae0-9d85-4d18-ba7b-4b75564028fb-kube-api-access-vmhkh\") pod \"multus-hkb6v\" (UID: \"5e50dae0-9d85-4d18-ba7b-4b75564028fb\") " pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.118955 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.118876 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs9st\" (UniqueName: \"kubernetes.io/projected/a14326df-f9c3-4c13-a0ab-a40a48f5d6e1-kube-api-access-hs9st\") pod \"iptables-alerter-x26h8\" (UID: \"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1\") " pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.119405 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.119386 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wpkw\" (UniqueName: \"kubernetes.io/projected/375bc743-21ff-4900-9b71-15c6aa813039-kube-api-access-2wpkw\") pod \"node-resolver-h9w27\" (UID: \"375bc743-21ff-4900-9b71-15c6aa813039\") " pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.119882 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.119860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hlmj\" (UniqueName: \"kubernetes.io/projected/f4ad60a4-a9de-4e15-a931-55bceabcf1f3-kube-api-access-6hlmj\") pod \"tuned-ggzls\" (UID: \"f4ad60a4-a9de-4e15-a931-55bceabcf1f3\") " pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.119925 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.119887 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfgfg\" (UniqueName: \"kubernetes.io/projected/e81f35da-d51e-4529-91b4-dfcaa96a8901-kube-api-access-jfgfg\") pod \"aws-ebs-csi-driver-node-bcxzz\" (UID: \"e81f35da-d51e-4529-91b4-dfcaa96a8901\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.215253 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.215178 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mllq9" Jul 23 18:02:22.221019 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.221003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hkb6v" Jul 23 18:02:22.223871 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.223851 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5045a998_463e_4b12_90f1_6a4588f4d439.slice/crio-ac9fdf799e153e738ae8c4d9995e4fb1782d473e700299087b36264eedfd9503 WatchSource:0}: Error finding container ac9fdf799e153e738ae8c4d9995e4fb1782d473e700299087b36264eedfd9503: Status 404 returned error can't find the container with id ac9fdf799e153e738ae8c4d9995e4fb1782d473e700299087b36264eedfd9503 Jul 23 18:02:22.228604 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.228582 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e50dae0_9d85_4d18_ba7b_4b75564028fb.slice/crio-2e4585b2092bda1712bd70046a12cbe99802e4b3ce734bb9504a515ca0b97275 WatchSource:0}: Error finding container 2e4585b2092bda1712bd70046a12cbe99802e4b3ce734bb9504a515ca0b97275: Status 404 returned error can't find the container with id 2e4585b2092bda1712bd70046a12cbe99802e4b3ce734bb9504a515ca0b97275 Jul 23 18:02:22.251664 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.251633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:22.259364 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.259339 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda615b62f_62de_45c8_9bf1_db84109bf36a.slice/crio-90c1462fe27bc307696325611756d4a4950c7616dbb3cf671f672c687f064f06 WatchSource:0}: Error finding container 90c1462fe27bc307696325611756d4a4950c7616dbb3cf671f672c687f064f06: Status 404 returned error can't find the container with id 90c1462fe27bc307696325611756d4a4950c7616dbb3cf671f672c687f064f06 Jul 23 18:02:22.277643 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.277623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" Jul 23 18:02:22.283514 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.283494 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h9w27" Jul 23 18:02:22.285162 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.285138 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode81f35da_d51e_4529_91b4_dfcaa96a8901.slice/crio-5771e4aac9df73f103d1a20462e6b97527550fb4a123645ebb3a303e19299fb6 WatchSource:0}: Error finding container 5771e4aac9df73f103d1a20462e6b97527550fb4a123645ebb3a303e19299fb6: Status 404 returned error can't find the container with id 5771e4aac9df73f103d1a20462e6b97527550fb4a123645ebb3a303e19299fb6 Jul 23 18:02:22.289934 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.289918 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x26h8" Jul 23 18:02:22.290706 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.290683 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375bc743_21ff_4900_9b71_15c6aa813039.slice/crio-889cab3eeaa7ff22e9a30c7a6509743d80960497730547d040ff8d041ff5dd5a WatchSource:0}: Error finding container 889cab3eeaa7ff22e9a30c7a6509743d80960497730547d040ff8d041ff5dd5a: Status 404 returned error can't find the container with id 889cab3eeaa7ff22e9a30c7a6509743d80960497730547d040ff8d041ff5dd5a Jul 23 18:02:22.294745 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.294720 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:22.297481 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.297456 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14326df_f9c3_4c13_a0ab_a40a48f5d6e1.slice/crio-0167cbf233f79934aea4ddd5c883f54c530e2a3e6214ef1bc04ebd8cd609a744 WatchSource:0}: Error finding container 0167cbf233f79934aea4ddd5c883f54c530e2a3e6214ef1bc04ebd8cd609a744: Status 404 returned error can't find the container with id 0167cbf233f79934aea4ddd5c883f54c530e2a3e6214ef1bc04ebd8cd609a744 Jul 23 18:02:22.300568 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.300547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5msvc" Jul 23 18:02:22.301582 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.301564 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0436d67e_a04b_4c43_9909_9b48d218b69d.slice/crio-8e6cd3ec00a5dcb19a6e9cd9b82a066ee04fd2488d25a664e309c0495019d766 WatchSource:0}: Error finding container 8e6cd3ec00a5dcb19a6e9cd9b82a066ee04fd2488d25a664e309c0495019d766: Status 404 returned error can't find the container with id 8e6cd3ec00a5dcb19a6e9cd9b82a066ee04fd2488d25a664e309c0495019d766 Jul 23 18:02:22.305606 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.305590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ggzls" Jul 23 18:02:22.308746 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.308717 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81524e11_cb7e_4cac_9d67_33901e97c2a9.slice/crio-404b0b0a9726cd4538717655d859e6c819d72f3d8f7bdbc8dce2d3636c3879de WatchSource:0}: Error finding container 404b0b0a9726cd4538717655d859e6c819d72f3d8f7bdbc8dce2d3636c3879de: Status 404 returned error can't find the container with id 404b0b0a9726cd4538717655d859e6c819d72f3d8f7bdbc8dce2d3636c3879de Jul 23 18:02:22.312926 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:02:22.312908 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ad60a4_a9de_4e15_a931_55bceabcf1f3.slice/crio-d6c2819eca885872e044bdc8221b71883d00cf9826499422854b4942a1edfa35 WatchSource:0}: Error finding container d6c2819eca885872e044bdc8221b71883d00cf9826499422854b4942a1edfa35: Status 404 returned error can't find the container with id d6c2819eca885872e044bdc8221b71883d00cf9826499422854b4942a1edfa35 Jul 23 18:02:22.608790 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.608756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:22.608976 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:22.608810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:22.608976 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.608950 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:22.608976 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.608958 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:22.609184 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.609046 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs podName:0ddc8e8b-0447-4544-9a4f-94582ab04012 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:23.60900921 +0000 UTC m=+3.103826008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs") pod "network-metrics-daemon-cpzsh" (UID: "0ddc8e8b-0447-4544-9a4f-94582ab04012") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:22.609184 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:22.609123 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret podName:97e7e893-89fd-455e-8475-0a13f62ee46c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:23.609055856 +0000 UTC m=+3.103872657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret") pod "global-pull-secret-syncer-z8kbh" (UID: "97e7e893-89fd-455e-8475-0a13f62ee46c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:23.964196 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:23.963632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:23.964196 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:23.963786 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:02:23.964196 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:23.963806 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:02:23.964196 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:23.963817 2580 projected.go:196] Error preparing data for projected volume kube-api-access-vjtlk for pod openshift-network-diagnostics/network-check-target-hn6bs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:23.964196 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:23.963865 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk podName:bb63282e-081b-448c-9d99-44973804abd5 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:24.963851366 +0000 UTC m=+3.204363023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjtlk" (UniqueName: "kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk") pod "network-check-target-hn6bs" (UID: "bb63282e-081b-448c-9d99-44973804abd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:24.198265 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.198144 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:57:23 +0000 UTC" deadline="2027-12-21 04:49:16.312742098 +0000 UTC" Jul 23 18:02:24.198265 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.198215 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12370h46m52.114531044s" Jul 23 18:02:24.260566 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.259798 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:24.260566 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.259924 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:24.260566 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.260409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:24.260566 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.260506 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:24.275553 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.275525 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggzls" event={"ID":"f4ad60a4-a9de-4e15-a931-55bceabcf1f3","Type":"ContainerStarted","Data":"d6c2819eca885872e044bdc8221b71883d00cf9826499422854b4942a1edfa35"} Jul 23 18:02:24.287680 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.287589 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerStarted","Data":"404b0b0a9726cd4538717655d859e6c819d72f3d8f7bdbc8dce2d3636c3879de"} Jul 23 18:02:24.296201 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.295985 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:02:24.296558 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.296522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h9w27" event={"ID":"375bc743-21ff-4900-9b71-15c6aa813039","Type":"ContainerStarted","Data":"889cab3eeaa7ff22e9a30c7a6509743d80960497730547d040ff8d041ff5dd5a"} Jul 23 18:02:24.305649 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.305613 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qv67x" event={"ID":"a615b62f-62de-45c8-9bf1-db84109bf36a","Type":"ContainerStarted","Data":"90c1462fe27bc307696325611756d4a4950c7616dbb3cf671f672c687f064f06"} Jul 23 18:02:24.311603 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.311569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hkb6v" event={"ID":"5e50dae0-9d85-4d18-ba7b-4b75564028fb","Type":"ContainerStarted","Data":"2e4585b2092bda1712bd70046a12cbe99802e4b3ce734bb9504a515ca0b97275"} Jul 23 18:02:24.322113 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.322046 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"8e6cd3ec00a5dcb19a6e9cd9b82a066ee04fd2488d25a664e309c0495019d766"} Jul 23 18:02:24.333053 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.332976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x26h8" event={"ID":"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1","Type":"ContainerStarted","Data":"0167cbf233f79934aea4ddd5c883f54c530e2a3e6214ef1bc04ebd8cd609a744"} Jul 23 18:02:24.335946 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.335910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" event={"ID":"e81f35da-d51e-4529-91b4-dfcaa96a8901","Type":"ContainerStarted","Data":"5771e4aac9df73f103d1a20462e6b97527550fb4a123645ebb3a303e19299fb6"} Jul 23 18:02:24.347684 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.347640 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mllq9" event={"ID":"5045a998-463e-4b12-90f1-6a4588f4d439","Type":"ContainerStarted","Data":"ac9fdf799e153e738ae8c4d9995e4fb1782d473e700299087b36264eedfd9503"} Jul 23 18:02:24.873536 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.873495 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:24.873733 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.873554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:24.873733 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.873675 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:24.873733 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.873690 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:24.873897 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.873755 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs podName:0ddc8e8b-0447-4544-9a4f-94582ab04012 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:26.873737399 +0000 UTC m=+5.114249057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs") pod "network-metrics-daemon-cpzsh" (UID: "0ddc8e8b-0447-4544-9a4f-94582ab04012") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:24.873897 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.873773 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret podName:97e7e893-89fd-455e-8475-0a13f62ee46c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:26.873764245 +0000 UTC m=+5.114275902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret") pod "global-pull-secret-syncer-z8kbh" (UID: "97e7e893-89fd-455e-8475-0a13f62ee46c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:24.975343 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:24.974672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:24.975343 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.974882 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:02:24.975343 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.974903 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:02:24.975343 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.974915 2580 projected.go:196] Error preparing data for projected volume kube-api-access-vjtlk for pod openshift-network-diagnostics/network-check-target-hn6bs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:24.975343 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:24.974972 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk podName:bb63282e-081b-448c-9d99-44973804abd5 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:26.974954249 +0000 UTC m=+5.215465925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjtlk" (UniqueName: "kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk") pod "network-check-target-hn6bs" (UID: "bb63282e-081b-448c-9d99-44973804abd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:25.198639 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:25.198505 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 17:57:23 +0000 UTC" deadline="2028-03-09 05:00:34.52998805 +0000 UTC" Jul 23 18:02:25.198639 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:25.198574 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14266h58m9.331419726s" Jul 23 18:02:25.257523 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:25.257480 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:25.257686 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:25.257612 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:26.037038 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:26.036446 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:02:26.259422 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:26.259389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:26.259817 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.259532 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:26.259963 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:26.259895 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:26.260069 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.260000 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:26.891104 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:26.891069 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:26.891345 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:26.891119 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:26.891345 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.891235 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:26.891345 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.891291 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs podName:0ddc8e8b-0447-4544-9a4f-94582ab04012 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:30.891271989 +0000 UTC m=+9.131783653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs") pod "network-metrics-daemon-cpzsh" (UID: "0ddc8e8b-0447-4544-9a4f-94582ab04012") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:26.891704 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.891684 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:26.891821 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.891736 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret podName:97e7e893-89fd-455e-8475-0a13f62ee46c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:30.891721944 +0000 UTC m=+9.132233609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret") pod "global-pull-secret-syncer-z8kbh" (UID: "97e7e893-89fd-455e-8475-0a13f62ee46c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:26.992147 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:26.992095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:26.992344 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.992284 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:02:26.992344 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.992306 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:02:26.992344 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.992317 2580 projected.go:196] Error preparing data for projected volume kube-api-access-vjtlk for pod openshift-network-diagnostics/network-check-target-hn6bs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:26.992531 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:26.992395 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk podName:bb63282e-081b-448c-9d99-44973804abd5 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:30.992378128 +0000 UTC m=+9.232889791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjtlk" (UniqueName: "kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk") pod "network-check-target-hn6bs" (UID: "bb63282e-081b-448c-9d99-44973804abd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:27.257559 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:27.257509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:27.257769 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:27.257658 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:28.267726 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:28.267236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:28.267726 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:28.267378 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:28.268411 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:28.268261 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:28.268411 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:28.268379 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:29.256869 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:29.256833 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:29.257050 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:29.256997 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:30.257256 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:30.256791 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:30.257256 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:30.256925 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:30.257256 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:30.256976 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:30.257256 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:30.257058 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:30.928672 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:30.928623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:30.928860 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:30.928685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:30.928924 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:30.928857 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:30.928960 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:30.928925 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs podName:0ddc8e8b-0447-4544-9a4f-94582ab04012 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:38.928902779 +0000 UTC m=+17.169414453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs") pod "network-metrics-daemon-cpzsh" (UID: "0ddc8e8b-0447-4544-9a4f-94582ab04012") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:30.929428 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:30.929322 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:30.929428 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:30.929394 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret podName:97e7e893-89fd-455e-8475-0a13f62ee46c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:38.929383283 +0000 UTC m=+17.169894941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret") pod "global-pull-secret-syncer-z8kbh" (UID: "97e7e893-89fd-455e-8475-0a13f62ee46c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:31.029230 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:31.029187 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:31.029437 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:31.029361 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:02:31.029437 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:31.029385 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:02:31.029437 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:31.029397 2580 projected.go:196] Error preparing data for projected volume kube-api-access-vjtlk for pod openshift-network-diagnostics/network-check-target-hn6bs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:31.029604 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:31.029465 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk podName:bb63282e-081b-448c-9d99-44973804abd5 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:39.029445664 +0000 UTC m=+17.269957324 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjtlk" (UniqueName: "kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk") pod "network-check-target-hn6bs" (UID: "bb63282e-081b-448c-9d99-44973804abd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:31.257414 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:31.257380 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:31.257863 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:31.257504 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:32.261440 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:32.261419 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:32.261796 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:32.261548 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:32.261993 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:32.261974 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:32.262094 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:32.262075 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:33.257344 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:33.257294 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:33.257522 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:33.257432 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:34.257046 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:34.257005 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:34.257495 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:34.257005 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:34.257495 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:34.257152 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:34.257495 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:34.257252 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:35.257057 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:35.257023 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:35.257456 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:35.257123 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:36.259872 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:36.259845 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:36.260310 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:36.259978 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:36.260310 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:36.260001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:36.260310 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:36.260102 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:37.256732 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:37.256700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:37.256907 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:37.256806 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:38.257423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:38.257389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:38.257879 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:38.257394 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:38.257879 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:38.257497 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:38.257879 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:38.257592 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:38.990278 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:38.990242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:38.990278 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:38.990294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:38.990594 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:38.990446 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:38.990594 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:38.990444 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:38.990594 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:38.990509 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs podName:0ddc8e8b-0447-4544-9a4f-94582ab04012 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:54.990490488 +0000 UTC m=+33.231002147 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs") pod "network-metrics-daemon-cpzsh" (UID: "0ddc8e8b-0447-4544-9a4f-94582ab04012") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:38.990594 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:38.990523 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret podName:97e7e893-89fd-455e-8475-0a13f62ee46c nodeName:}" failed. No retries permitted until 2026-07-23 18:02:54.99051774 +0000 UTC m=+33.231029398 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret") pod "global-pull-secret-syncer-z8kbh" (UID: "97e7e893-89fd-455e-8475-0a13f62ee46c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:39.091409 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:39.091370 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:39.091618 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:39.091562 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:02:39.091618 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:39.091591 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:02:39.091618 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:39.091606 2580 projected.go:196] Error preparing data for projected volume kube-api-access-vjtlk for pod openshift-network-diagnostics/network-check-target-hn6bs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:39.091763 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:39.091682 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk podName:bb63282e-081b-448c-9d99-44973804abd5 nodeName:}" failed. No retries permitted until 2026-07-23 18:02:55.091655806 +0000 UTC m=+33.332167467 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjtlk" (UniqueName: "kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk") pod "network-check-target-hn6bs" (UID: "bb63282e-081b-448c-9d99-44973804abd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:39.257675 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:39.257456 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:39.258063 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:39.257712 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:40.257385 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:40.257354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:40.257385 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:40.257388 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:40.257622 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:40.257492 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:40.257671 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:40.257632 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:41.256912 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:41.256883 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:41.257324 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:41.256993 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:42.258081 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:42.258049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:42.258475 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:42.258161 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:42.258475 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:42.258210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:42.258475 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:42.258313 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:43.257141 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:43.257095 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:43.257357 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:43.257226 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:44.256918 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.256754 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:44.257417 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.256793 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:44.257417 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:44.256999 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:44.257417 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:44.257125 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:44.391090 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.391018 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ggzls" event={"ID":"f4ad60a4-a9de-4e15-a931-55bceabcf1f3","Type":"ContainerStarted","Data":"db6c072d45a4fd2d48ec8c881c52ce9a8375cc652233d2e13a6605237d3ab118"} Jul 23 18:02:44.395845 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.394966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hkb6v" event={"ID":"5e50dae0-9d85-4d18-ba7b-4b75564028fb","Type":"ContainerStarted","Data":"f9dc7a9830c74802206d977c0be70a74ce0b973837832e687ad2f8067cbba345"} Jul 23 18:02:44.401041 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.399962 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"eefaee81133e975c158e108c5b8d926dd028d4c376e7fc4cbe3418d5ccb0209e"} Jul 23 18:02:44.401041 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.400045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"38c552a878dbc511fd3c37313c5bad625ecf910eef3bed6a0432127ffabe2cf5"} Jul 23 18:02:44.401041 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.400097 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"2603b9444e98f79825a8e887812a60eb0c53948808f786a74408d389e1a71def"} Jul 23 18:02:44.401041 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.400144 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"60092db27fd21ecaae83c94a6aaf5072103536d25548fac5f9e84e5d60ab169a"} Jul 23 18:02:44.401041 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.400192 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"164b62f48738b92e08b963a6358fee55a93c7cc338cd3c6be2dfbcddf13698da"} Jul 23 18:02:44.402145 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.402123 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" event={"ID":"68a6a4a068480f33d4378a102cee2ec2","Type":"ContainerStarted","Data":"4639d138b74f3ccfead9314d4a967bb18aee6a235841c174dbe85404e592dc40"} Jul 23 18:02:44.437354 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.437128 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-130.ec2.internal" podStartSLOduration=21.437113086 podStartE2EDuration="21.437113086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:44.436758007 +0000 UTC m=+22.677269688" watchObservedRunningTime="2026-07-23 18:02:44.437113086 +0000 UTC m=+22.677624766" Jul 23 18:02:44.437354 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.437204 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ggzls" podStartSLOduration=2.301284302 podStartE2EDuration="22.437200045s" totalImagesPullingTime="20.135915743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:44.411752228 +0000 UTC m=+22.652263909" watchObservedRunningTime="2026-07-23 18:02:44.437200045 +0000 UTC m=+22.677711726" Jul 23 18:02:44.462070 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:44.462020 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hkb6v" podStartSLOduration=2.200947516 podStartE2EDuration="22.462000323s" totalImagesPullingTime="20.261052807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:44.461177264 +0000 UTC m=+22.701688945" watchObservedRunningTime="2026-07-23 18:02:44.462000323 +0000 UTC m=+22.702512009" Jul 23 18:02:45.256740 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.256708 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:45.256929 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:45.256808 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:45.407208 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.407120 2580 generic.go:356] "Generic (PLEG): container finished" podID="94312c955e17d448c2c7c3aefbb15c00" containerID="61c4a862989e8d73bb8e7c394ea80f03c2fe4b5c0b31fbbde5e4f69e77ac2181" exitCode=0 Jul 23 18:02:45.407483 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.407204 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" event={"ID":"94312c955e17d448c2c7c3aefbb15c00","Type":"ContainerDied","Data":"61c4a862989e8d73bb8e7c394ea80f03c2fe4b5c0b31fbbde5e4f69e77ac2181"} Jul 23 18:02:45.408799 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.408766 2580 generic.go:356] "Generic (PLEG): container finished" podID="81524e11-cb7e-4cac-9d67-33901e97c2a9" containerID="cdca45cfe3f39a76445573c6c80d82d3d76d7dfbebf1a808a2b995f84a9a02a1" exitCode=0 Jul 23 18:02:45.408903 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.408829 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerDied","Data":"cdca45cfe3f39a76445573c6c80d82d3d76d7dfbebf1a808a2b995f84a9a02a1"} Jul 23 18:02:45.413800 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.413777 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h9w27" event={"ID":"375bc743-21ff-4900-9b71-15c6aa813039","Type":"ContainerStarted","Data":"27885a00decea22e2a75129a068f62d051e17cd74f55ebde53f8fcdfae29a0b4"} Jul 23 18:02:45.415389 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.415367 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qv67x" event={"ID":"a615b62f-62de-45c8-9bf1-db84109bf36a","Type":"ContainerStarted","Data":"d356b6d7ef9e3dd6f6e27c3c690aec0cec83b848f5b44674c21b80dedc2528eb"} Jul 23 18:02:45.418190 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.418172 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"f2d3743e457f44a488d9e5daa9e5ac9488c44751fcaa4bc9a194cb2113512df6"} Jul 23 18:02:45.419563 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.419544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x26h8" event={"ID":"a14326df-f9c3-4c13-a0ab-a40a48f5d6e1","Type":"ContainerStarted","Data":"103ab3aee1bae9aa9ce895ca1c19b1c59319f0316d93d72a7abed92b8a508bb0"} Jul 23 18:02:45.420742 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.420723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" event={"ID":"e81f35da-d51e-4529-91b4-dfcaa96a8901","Type":"ContainerStarted","Data":"86a44133ce38de4d2617f79d7752dbe85865dcc06553e6c434374add06d734f0"} Jul 23 18:02:45.421913 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.421895 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mllq9" event={"ID":"5045a998-463e-4b12-90f1-6a4588f4d439","Type":"ContainerStarted","Data":"8b7e054faf7a3f76c2a1944152aa17a86f7fb6d38c29c448f1642896ff485845"} Jul 23 18:02:45.441783 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.441539 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qv67x" podStartSLOduration=3.27528011 podStartE2EDuration="23.441522606s" totalImagesPullingTime="20.166242496s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:45.441097201 +0000 UTC m=+23.681608882" watchObservedRunningTime="2026-07-23 18:02:45.441522606 +0000 UTC m=+23.682034287" Jul 23 18:02:45.458175 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.458130 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h9w27" podStartSLOduration=3.31799178 podStartE2EDuration="23.458113888s" totalImagesPullingTime="20.140122108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:45.457817517 +0000 UTC m=+23.698329197" watchObservedRunningTime="2026-07-23 18:02:45.458113888 +0000 UTC m=+23.698625569" Jul 23 18:02:45.495987 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.495907 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x26h8" podStartSLOduration=3.393584592 podStartE2EDuration="23.495886066s" totalImagesPullingTime="20.102301474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:45.495647081 +0000 UTC m=+23.736158761" watchObservedRunningTime="2026-07-23 18:02:45.495886066 +0000 UTC m=+23.736397748" Jul 23 18:02:45.511633 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:45.511594 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mllq9" podStartSLOduration=3.336033509 podStartE2EDuration="23.511580491s" totalImagesPullingTime="20.175546982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:45.511551104 +0000 UTC m=+23.752062784" watchObservedRunningTime="2026-07-23 18:02:45.511580491 +0000 UTC m=+23.752092171" Jul 23 18:02:46.118688 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.118667 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 18:02:46.217672 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.217574 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:02:46.11868535Z","UUID":"5d593290-5be6-4d2e-b4b0-4e8a7ac19b67","Handler":null,"Name":"","Endpoint":""} Jul 23 18:02:46.219234 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.219204 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 18:02:46.219385 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.219245 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 18:02:46.257393 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.257363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:46.257957 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:46.257486 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:46.257957 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.257547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:46.257957 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:46.257649 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:46.427250 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.427160 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" event={"ID":"e81f35da-d51e-4529-91b4-dfcaa96a8901","Type":"ContainerStarted","Data":"43bc489e8fca61c93462f3cb9fbd07ed5b3a26ac2007d3b723b2b75e7abedda2"} Jul 23 18:02:46.429384 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:46.429312 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" event={"ID":"94312c955e17d448c2c7c3aefbb15c00","Type":"ContainerStarted","Data":"99adde863a99d2bc34840febe97bec277c3f50432ef4ccac8da0606f3d98db0f"} Jul 23 18:02:47.256812 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:47.256784 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:47.257138 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:47.256898 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:47.434920 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:47.434875 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"b18de021d8b96826ca3b7cac67c48bdee9ad90f692723ddd4c5d8fc000c85847"} Jul 23 18:02:47.437193 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:47.437125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" event={"ID":"e81f35da-d51e-4529-91b4-dfcaa96a8901","Type":"ContainerStarted","Data":"d841ab7d3104749ded976e33773a713ba4585b09ab1f2e4d8f532eb0a35aed25"} Jul 23 18:02:47.457586 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:47.457525 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bcxzz" podStartSLOduration=2.529411964 podStartE2EDuration="25.457506916s" totalImagesPullingTime="22.928094952s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:47.457369448 +0000 UTC m=+25.697881130" watchObservedRunningTime="2026-07-23 18:02:47.457506916 +0000 UTC m=+25.698018597" Jul 23 18:02:47.458167 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:47.458132 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-130.ec2.internal" podStartSLOduration=24.45812091 podStartE2EDuration="24.45812091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:46.448962385 +0000 UTC m=+24.689474061" watchObservedRunningTime="2026-07-23 18:02:47.45812091 +0000 UTC m=+25.698632590" Jul 23 18:02:48.170212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:48.170181 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:48.170785 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:48.170763 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:48.257094 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:48.257062 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:48.257273 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:48.257178 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:48.257273 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:48.257231 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:48.257412 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:48.257352 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:48.439374 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:48.439276 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:48.439806 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:48.439757 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qv67x" Jul 23 18:02:49.257008 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:49.256980 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:49.257185 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:49.257116 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:50.257393 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.257167 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:50.258070 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.257219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:50.258070 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:50.257490 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:50.258070 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:50.257550 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:50.446402 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.446366 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" event={"ID":"0436d67e-a04b-4c43-9909-9b48d218b69d","Type":"ContainerStarted","Data":"f3ffbf3ce94bb4d151d7914e262d19748fbc595b1fa6c361bfe65efca5fe4cd6"} Jul 23 18:02:50.446644 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.446628 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:50.446708 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.446691 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:50.448804 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.448779 2580 generic.go:356] "Generic (PLEG): container finished" podID="81524e11-cb7e-4cac-9d67-33901e97c2a9" containerID="93ecd5a3afc29d9534fa332a537a8072403f2710e5294e3f46428900c0096466" exitCode=0 Jul 23 18:02:50.448892 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.448845 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerDied","Data":"93ecd5a3afc29d9534fa332a537a8072403f2710e5294e3f46428900c0096466"} Jul 23 18:02:50.462813 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.462794 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:50.476141 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:50.476101 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" podStartSLOduration=8.280419776 podStartE2EDuration="28.476088276s" totalImagesPullingTime="20.1956685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:02:50.474605749 +0000 UTC m=+28.715117428" watchObservedRunningTime="2026-07-23 18:02:50.476088276 +0000 UTC m=+28.716599957" Jul 23 18:02:51.257105 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.257080 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:51.257282 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:51.257225 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:51.451203 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.451176 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:51.466996 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.466970 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:02:51.828065 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.827889 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z8kbh"] Jul 23 18:02:51.828206 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.828189 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:51.828293 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:51.828274 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:51.831032 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.830711 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hn6bs"] Jul 23 18:02:51.831032 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.830825 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:51.831032 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:51.830927 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:51.831564 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.831540 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cpzsh"] Jul 23 18:02:51.831676 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:51.831652 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:51.831793 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:51.831769 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:52.454904 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:52.454870 2580 generic.go:356] "Generic (PLEG): container finished" podID="81524e11-cb7e-4cac-9d67-33901e97c2a9" containerID="674141d225fef4d9077592b563d1e0b2f09220b218642176f792d499d0092975" exitCode=0 Jul 23 18:02:52.455294 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:52.454955 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerDied","Data":"674141d225fef4d9077592b563d1e0b2f09220b218642176f792d499d0092975"} Jul 23 18:02:53.257646 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:53.257611 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:53.257782 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:53.257748 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:53.258244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:53.258219 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:53.258396 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:53.258371 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:53.258502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:53.258430 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:53.258546 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:53.258512 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:54.461440 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:54.461403 2580 generic.go:356] "Generic (PLEG): container finished" podID="81524e11-cb7e-4cac-9d67-33901e97c2a9" containerID="6bdb765c4d5566a29405c881977868654e9a24c2caec7825a1164c8432c19b48" exitCode=0 Jul 23 18:02:54.461813 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:54.461461 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerDied","Data":"6bdb765c4d5566a29405c881977868654e9a24c2caec7825a1164c8432c19b48"} Jul 23 18:02:55.014628 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:55.014595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:55.014628 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:55.014635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:55.014833 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.014739 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:55.014833 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.014740 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:55.014833 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.014797 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs podName:0ddc8e8b-0447-4544-9a4f-94582ab04012 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:27.014780816 +0000 UTC m=+65.255292497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs") pod "network-metrics-daemon-cpzsh" (UID: "0ddc8e8b-0447-4544-9a4f-94582ab04012") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:02:55.014833 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.014813 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret podName:97e7e893-89fd-455e-8475-0a13f62ee46c nodeName:}" failed. No retries permitted until 2026-07-23 18:03:27.014805548 +0000 UTC m=+65.255317207 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret") pod "global-pull-secret-syncer-z8kbh" (UID: "97e7e893-89fd-455e-8475-0a13f62ee46c") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:02:55.115286 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:55.115247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:55.115490 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.115416 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:02:55.115490 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.115447 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:02:55.115490 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.115461 2580 projected.go:196] Error preparing data for projected volume kube-api-access-vjtlk for pod openshift-network-diagnostics/network-check-target-hn6bs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:55.115653 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.115528 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk podName:bb63282e-081b-448c-9d99-44973804abd5 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:27.115510479 +0000 UTC m=+65.356022139 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vjtlk" (UniqueName: "kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk") pod "network-check-target-hn6bs" (UID: "bb63282e-081b-448c-9d99-44973804abd5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:02:55.256977 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:55.256943 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:55.256977 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:55.256965 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:55.257201 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:55.257062 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:55.257201 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.257069 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hn6bs" podUID="bb63282e-081b-448c-9d99-44973804abd5" Jul 23 18:02:55.257201 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.257141 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-z8kbh" podUID="97e7e893-89fd-455e-8475-0a13f62ee46c" Jul 23 18:02:55.257308 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:55.257232 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cpzsh" podUID="0ddc8e8b-0447-4544-9a4f-94582ab04012" Jul 23 18:02:56.573021 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.572993 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-130.ec2.internal" event="NodeReady" Jul 23 18:02:56.573504 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.573142 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 18:02:56.624906 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.624865 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ppgk5"] Jul 23 18:02:56.627349 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.627305 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-nmdrc"] Jul 23 18:02:56.627487 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.627452 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.629318 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.629297 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:56.631844 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.631826 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vl72\"" Jul 23 18:02:56.632703 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.632658 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 18:02:56.632703 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.632699 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 18:02:56.632986 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.632969 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 18:02:56.633066 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.633055 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w9bh8\"" Jul 23 18:02:56.633500 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.633481 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 18:02:56.634701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.634680 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 18:02:56.641025 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.640998 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppgk5"] Jul 23 18:02:56.644362 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.644021 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmdrc"] Jul 23 18:02:56.727374 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.727324 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.727530 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.727385 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4h7\" (UniqueName: \"kubernetes.io/projected/ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff-kube-api-access-4s4h7\") pod \"ingress-canary-nmdrc\" (UID: \"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff\") " pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:56.727530 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.727469 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff-cert\") pod \"ingress-canary-nmdrc\" (UID: \"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff\") " pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:56.727530 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.727508 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-config-volume\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.727753 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.727539 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-tmp-dir\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.727753 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.727563 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5c4g\" (UniqueName: \"kubernetes.io/projected/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-kube-api-access-z5c4g\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.828768 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.828677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-config-volume\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.828768 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.828730 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-tmp-dir\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.828768 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.828758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5c4g\" (UniqueName: \"kubernetes.io/projected/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-kube-api-access-z5c4g\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.829038 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.829016 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.829093 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.829055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4h7\" (UniqueName: \"kubernetes.io/projected/ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff-kube-api-access-4s4h7\") pod \"ingress-canary-nmdrc\" (UID: \"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff\") " pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:56.829093 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.829079 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff-cert\") pod \"ingress-canary-nmdrc\" (UID: \"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff\") " pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:56.829197 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:56.829179 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:02:56.829271 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:56.829256 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls podName:1cf1a438-fcad-4f8d-9800-5be27aab0e8f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:57.32923753 +0000 UTC m=+35.569749190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls") pod "dns-default-ppgk5" (UID: "1cf1a438-fcad-4f8d-9800-5be27aab0e8f") : secret "dns-default-metrics-tls" not found Jul 23 18:02:56.830222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.830053 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-tmp-dir\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.830367 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.830325 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-config-volume\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.834624 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.834604 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff-cert\") pod \"ingress-canary-nmdrc\" (UID: \"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff\") " pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:56.838647 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.838626 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4h7\" (UniqueName: \"kubernetes.io/projected/ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff-kube-api-access-4s4h7\") pod \"ingress-canary-nmdrc\" (UID: \"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff\") " pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:56.839768 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.839738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5c4g\" (UniqueName: \"kubernetes.io/projected/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-kube-api-access-z5c4g\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:56.948038 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:56.948003 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-nmdrc" Jul 23 18:02:57.105555 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.105475 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-nmdrc"] Jul 23 18:02:57.257675 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.257637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:02:57.257841 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.257637 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:02:57.257899 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.257648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:02:57.262742 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.262712 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:02:57.262981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.262961 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbpx\"" Jul 23 18:02:57.263256 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.263235 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:02:57.264822 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.264057 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqhz\"" Jul 23 18:02:57.264822 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.264256 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:02:57.264822 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.264437 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:02:57.333098 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:57.333058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:57.333278 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:57.333218 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:02:57.333370 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:57.333294 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls podName:1cf1a438-fcad-4f8d-9800-5be27aab0e8f nodeName:}" failed. No retries permitted until 2026-07-23 18:02:58.333274757 +0000 UTC m=+36.573786415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls") pod "dns-default-ppgk5" (UID: "1cf1a438-fcad-4f8d-9800-5be27aab0e8f") : secret "dns-default-metrics-tls" not found Jul 23 18:02:58.331695 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.331652 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd"] Jul 23 18:02:58.334496 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.334475 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:02:58.337032 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.337000 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 23 18:02:58.337158 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.337067 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s774g\"" Jul 23 18:02:58.338463 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.338436 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 23 18:02:58.342258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.341346 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:02:58.342258 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:58.341440 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:02:58.342258 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:58.341502 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls podName:1cf1a438-fcad-4f8d-9800-5be27aab0e8f nodeName:}" failed. No retries permitted until 2026-07-23 18:03:00.341486941 +0000 UTC m=+38.581998598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls") pod "dns-default-ppgk5" (UID: "1cf1a438-fcad-4f8d-9800-5be27aab0e8f") : secret "dns-default-metrics-tls" not found Jul 23 18:02:58.345601 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.345582 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd"] Jul 23 18:02:58.442515 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.442472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/524375a6-795e-4202-9bbb-72a23c296ffa-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:02:58.442667 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.442521 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:02:58.543700 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.543666 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/524375a6-795e-4202-9bbb-72a23c296ffa-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:02:58.543700 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.543703 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:02:58.543940 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:58.543848 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:02:58.543940 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:58.543925 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert podName:524375a6-795e-4202-9bbb-72a23c296ffa nodeName:}" failed. No retries permitted until 2026-07-23 18:02:59.043911343 +0000 UTC m=+37.284423001 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-njhmd" (UID: "524375a6-795e-4202-9bbb-72a23c296ffa") : secret "networking-console-plugin-cert" not found Jul 23 18:02:58.545063 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:58.545040 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/524375a6-795e-4202-9bbb-72a23c296ffa-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:02:59.047616 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:59.047569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:02:59.047785 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:59.047725 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:02:59.047851 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:02:59.047799 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert podName:524375a6-795e-4202-9bbb-72a23c296ffa nodeName:}" failed. No retries permitted until 2026-07-23 18:03:00.047779223 +0000 UTC m=+38.288290887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-njhmd" (UID: "524375a6-795e-4202-9bbb-72a23c296ffa") : secret "networking-console-plugin-cert" not found Jul 23 18:02:59.474770 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:59.474680 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmdrc" event={"ID":"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff","Type":"ContainerStarted","Data":"9c4513de707ff2ffc84a3c3fe671323386f0d4d58e49318c36b44fe705a16b84"} Jul 23 18:02:59.478451 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:59.478416 2580 generic.go:356] "Generic (PLEG): container finished" podID="81524e11-cb7e-4cac-9d67-33901e97c2a9" containerID="db556b783a56d1378f3bf98a15dbcaec5e813e7bdbcaffa6a24a59d0719b340a" exitCode=0 Jul 23 18:02:59.478592 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:02:59.478470 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerDied","Data":"db556b783a56d1378f3bf98a15dbcaec5e813e7bdbcaffa6a24a59d0719b340a"} Jul 23 18:03:00.056198 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:00.055931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:03:00.056398 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:00.056105 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:03:00.056398 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:00.056299 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert podName:524375a6-795e-4202-9bbb-72a23c296ffa nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.056276929 +0000 UTC m=+40.296788593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-njhmd" (UID: "524375a6-795e-4202-9bbb-72a23c296ffa") : secret "networking-console-plugin-cert" not found Jul 23 18:03:00.358150 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:00.358055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:00.358320 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:00.358199 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:03:00.358320 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:00.358278 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls podName:1cf1a438-fcad-4f8d-9800-5be27aab0e8f nodeName:}" failed. No retries permitted until 2026-07-23 18:03:04.358257223 +0000 UTC m=+42.598768882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls") pod "dns-default-ppgk5" (UID: "1cf1a438-fcad-4f8d-9800-5be27aab0e8f") : secret "dns-default-metrics-tls" not found Jul 23 18:03:00.484180 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:00.484148 2580 generic.go:356] "Generic (PLEG): container finished" podID="81524e11-cb7e-4cac-9d67-33901e97c2a9" containerID="38d5bf937de7ffac70276a5a665e6b035eff7fcd31f8b5277acda86ea57848d6" exitCode=0 Jul 23 18:03:00.484578 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:00.484213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerDied","Data":"38d5bf937de7ffac70276a5a665e6b035eff7fcd31f8b5277acda86ea57848d6"} Jul 23 18:03:01.488128 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:01.488099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-nmdrc" event={"ID":"ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff","Type":"ContainerStarted","Data":"b099ea3c09affa5127cd8bd8e1cec7ea2497137697c91f5e07f3e0b3273fc2fc"} Jul 23 18:03:01.491661 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:01.491629 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5msvc" event={"ID":"81524e11-cb7e-4cac-9d67-33901e97c2a9","Type":"ContainerStarted","Data":"988c01cf0d2838400ba92f07742886127d67d9de81548dd401c571c2de68cb32"} Jul 23 18:03:01.511252 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:01.511201 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-nmdrc" podStartSLOduration=3.079135035 podStartE2EDuration="5.511186255s" totalImagesPullingTime="2.43205122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.510765528 +0000 UTC m=+39.751277209" watchObservedRunningTime="2026-07-23 18:03:01.511186255 +0000 UTC m=+39.751697971" Jul 23 18:03:01.544995 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:01.544944 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5msvc" podStartSLOduration=8.794842491 podStartE2EDuration="39.544926222s" totalImagesPullingTime="30.750083731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:01.544618114 +0000 UTC m=+39.785129793" watchObservedRunningTime="2026-07-23 18:03:01.544926222 +0000 UTC m=+39.785437903" Jul 23 18:03:02.071114 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.071073 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:03:02.071269 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.071187 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:03:02.071269 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.071247 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert podName:524375a6-795e-4202-9bbb-72a23c296ffa nodeName:}" failed. No retries permitted until 2026-07-23 18:03:06.071230723 +0000 UTC m=+44.311742385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-njhmd" (UID: "524375a6-795e-4202-9bbb-72a23c296ffa") : secret "networking-console-plugin-cert" not found Jul 23 18:03:02.216168 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.216135 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7mrlv"] Jul 23 18:03:02.251343 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.251293 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7mrlv"] Jul 23 18:03:02.251514 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.251425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.254616 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.254588 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 18:03:02.255063 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.255040 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 18:03:02.255189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.255170 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xtwn7\"" Jul 23 18:03:02.255262 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.255246 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 18:03:02.255878 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.255859 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 18:03:02.373347 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.373230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6001d54-1682-46ba-8d87-4d880b4ff470-crio-socket\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.373347 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.373279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.373533 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.373407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljfbr\" (UniqueName: \"kubernetes.io/projected/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-api-access-ljfbr\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.373533 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.373448 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6001d54-1682-46ba-8d87-4d880b4ff470-data-volume\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.373533 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.373467 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.421164 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.421124 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d"] Jul 23 18:03:02.437053 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.437021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" Jul 23 18:03:02.442576 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.442549 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 23 18:03:02.443206 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.443186 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 23 18:03:02.444223 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.444202 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jm26q\"" Jul 23 18:03:02.446888 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.446867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d"] Jul 23 18:03:02.473913 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.473887 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljfbr\" (UniqueName: \"kubernetes.io/projected/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-api-access-ljfbr\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.474060 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.473932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6001d54-1682-46ba-8d87-4d880b4ff470-data-volume\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.474060 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.473955 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.474060 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.474026 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:03:02.474182 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.474074 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.974060881 +0000 UTC m=+41.214572558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : configmap "kube-rbac-proxy" not found Jul 23 18:03:02.474182 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.474159 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6001d54-1682-46ba-8d87-4d880b4ff470-crio-socket\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.474261 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.474194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.474303 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.474285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a6001d54-1682-46ba-8d87-4d880b4ff470-data-volume\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.474371 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.474354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a6001d54-1682-46ba-8d87-4d880b4ff470-crio-socket\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.474410 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.474357 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:03:02.474456 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.474446 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:02.974420874 +0000 UTC m=+41.214932532 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : secret "insights-runtime-extractor-tls" not found Jul 23 18:03:02.492529 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.492503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljfbr\" (UniqueName: \"kubernetes.io/projected/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-api-access-ljfbr\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.575648 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.575611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rqv9\" (UniqueName: \"kubernetes.io/projected/93c37885-cfc5-4cad-9f20-ae25b2e6176b-kube-api-access-9rqv9\") pod \"migrator-7cc9c7ffd7-jtr5d\" (UID: \"93c37885-cfc5-4cad-9f20-ae25b2e6176b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" Jul 23 18:03:02.676422 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.676317 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rqv9\" (UniqueName: \"kubernetes.io/projected/93c37885-cfc5-4cad-9f20-ae25b2e6176b-kube-api-access-9rqv9\") pod \"migrator-7cc9c7ffd7-jtr5d\" (UID: \"93c37885-cfc5-4cad-9f20-ae25b2e6176b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" Jul 23 18:03:02.690778 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.690749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rqv9\" (UniqueName: \"kubernetes.io/projected/93c37885-cfc5-4cad-9f20-ae25b2e6176b-kube-api-access-9rqv9\") pod \"migrator-7cc9c7ffd7-jtr5d\" (UID: \"93c37885-cfc5-4cad-9f20-ae25b2e6176b\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" Jul 23 18:03:02.745640 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.745601 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" Jul 23 18:03:02.886824 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.886796 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d"] Jul 23 18:03:02.889559 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:02.889525 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c37885_cfc5_4cad_9f20_ae25b2e6176b.slice/crio-03728e686a5dfc141f17e5858e981d9621b618965032a03ecaccfb830679b5d3 WatchSource:0}: Error finding container 03728e686a5dfc141f17e5858e981d9621b618965032a03ecaccfb830679b5d3: Status 404 returned error can't find the container with id 03728e686a5dfc141f17e5858e981d9621b618965032a03ecaccfb830679b5d3 Jul 23 18:03:02.979964 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.979869 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.979964 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:02.979931 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:02.980194 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.980005 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:03:02.980194 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.980046 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:03:02.980194 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.980090 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:03.980077476 +0000 UTC m=+42.220589133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : secret "insights-runtime-extractor-tls" not found Jul 23 18:03:02.980194 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:02.980103 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:03.980096651 +0000 UTC m=+42.220608309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : configmap "kube-rbac-proxy" not found Jul 23 18:03:03.497348 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:03.497291 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" event={"ID":"93c37885-cfc5-4cad-9f20-ae25b2e6176b","Type":"ContainerStarted","Data":"03728e686a5dfc141f17e5858e981d9621b618965032a03ecaccfb830679b5d3"} Jul 23 18:03:03.987541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:03.987508 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:03.987701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:03.987595 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:03.987701 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:03.987632 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:03:03.987701 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:03.987701 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:05.987684505 +0000 UTC m=+44.228196167 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : configmap "kube-rbac-proxy" not found Jul 23 18:03:03.987854 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:03.987756 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:03:03.987854 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:03.987813 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:05.987799372 +0000 UTC m=+44.228311034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : secret "insights-runtime-extractor-tls" not found Jul 23 18:03:04.182786 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.182756 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h9w27_375bc743-21ff-4900-9b71-15c6aa813039/dns-node-resolver/0.log" Jul 23 18:03:04.391292 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.391202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:04.391460 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:04.391393 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:03:04.391460 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:04.391456 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls podName:1cf1a438-fcad-4f8d-9800-5be27aab0e8f nodeName:}" failed. No retries permitted until 2026-07-23 18:03:12.391441773 +0000 UTC m=+50.631953432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls") pod "dns-default-ppgk5" (UID: "1cf1a438-fcad-4f8d-9800-5be27aab0e8f") : secret "dns-default-metrics-tls" not found Jul 23 18:03:04.876204 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.876178 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-49fdv"] Jul 23 18:03:04.897442 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.897416 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-49fdv"] Jul 23 18:03:04.897559 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.897525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:04.900458 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.900402 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bwrz5\"" Jul 23 18:03:04.900458 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.900442 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 23 18:03:04.901721 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.901699 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 23 18:03:04.901838 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.901739 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 23 18:03:04.901896 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.901842 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 23 18:03:04.995450 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.995411 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq6fq\" (UniqueName: \"kubernetes.io/projected/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-kube-api-access-vq6fq\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:04.995450 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.995455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-signing-key\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:04.995674 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:04.995498 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-signing-cabundle\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.096192 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.096158 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq6fq\" (UniqueName: \"kubernetes.io/projected/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-kube-api-access-vq6fq\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.096319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.096198 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-signing-key\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.096399 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.096371 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-signing-cabundle\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.096939 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.096920 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-signing-cabundle\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.098781 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.098762 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-signing-key\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.106445 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.106418 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq6fq\" (UniqueName: \"kubernetes.io/projected/df8e4c2c-ea2b-462a-96dd-472a6fa2938a-kube-api-access-vq6fq\") pod \"service-ca-58598695f7-49fdv\" (UID: \"df8e4c2c-ea2b-462a-96dd-472a6fa2938a\") " pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.206707 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.206619 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-49fdv" Jul 23 18:03:05.359159 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.359131 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-49fdv"] Jul 23 18:03:05.362010 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:05.361987 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8e4c2c_ea2b_462a_96dd_472a6fa2938a.slice/crio-075e02c2ffd9e9576c97466aa65fe1435f4dd175d2a0f971e1661f2edbbac82c WatchSource:0}: Error finding container 075e02c2ffd9e9576c97466aa65fe1435f4dd175d2a0f971e1661f2edbbac82c: Status 404 returned error can't find the container with id 075e02c2ffd9e9576c97466aa65fe1435f4dd175d2a0f971e1661f2edbbac82c Jul 23 18:03:05.383635 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.383618 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mllq9_5045a998-463e-4b12-90f1-6a4588f4d439/node-ca/0.log" Jul 23 18:03:05.504134 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.504104 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" event={"ID":"93c37885-cfc5-4cad-9f20-ae25b2e6176b","Type":"ContainerStarted","Data":"0a7ebaab1ae648a881270cd36ad93c15b79097c7f4485a9a22dde25ff38e6826"} Jul 23 18:03:05.504314 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.504156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" event={"ID":"93c37885-cfc5-4cad-9f20-ae25b2e6176b","Type":"ContainerStarted","Data":"8320cec0de42bc2fded3448ba4b3b902e5f6eee1fad0577144c09669f51e669a"} Jul 23 18:03:05.505222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.505200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-49fdv" event={"ID":"df8e4c2c-ea2b-462a-96dd-472a6fa2938a","Type":"ContainerStarted","Data":"075e02c2ffd9e9576c97466aa65fe1435f4dd175d2a0f971e1661f2edbbac82c"} Jul 23 18:03:05.522516 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.522463 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-jtr5d" podStartSLOduration=1.787020091 podStartE2EDuration="3.522444163s" totalImagesPullingTime="1.735424072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:05.521944054 +0000 UTC m=+43.762455734" watchObservedRunningTime="2026-07-23 18:03:05.522444163 +0000 UTC m=+43.762955844" Jul 23 18:03:05.987483 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:05.987450 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmdrc_ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff/serve-healthcheck-canary/0.log" Jul 23 18:03:06.003692 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:06.003628 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:06.003775 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:06.003742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:06.003806 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:06.003780 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:03:06.003835 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:06.003809 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:03:06.003880 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:06.003851 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:10.003835625 +0000 UTC m=+48.244347288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : secret "insights-runtime-extractor-tls" not found Jul 23 18:03:06.003880 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:06.003865 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:10.003859452 +0000 UTC m=+48.244371110 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : configmap "kube-rbac-proxy" not found Jul 23 18:03:06.104306 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:06.104267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:03:06.104467 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:06.104421 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:03:06.104506 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:06.104489 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert podName:524375a6-795e-4202-9bbb-72a23c296ffa nodeName:}" failed. No retries permitted until 2026-07-23 18:03:14.104472452 +0000 UTC m=+52.344984122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-njhmd" (UID: "524375a6-795e-4202-9bbb-72a23c296ffa") : secret "networking-console-plugin-cert" not found Jul 23 18:03:09.518022 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:09.517983 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-49fdv" event={"ID":"df8e4c2c-ea2b-462a-96dd-472a6fa2938a","Type":"ContainerStarted","Data":"d593cf7acd12bac56b9193d8be2215e6543ad18dde4251491a12aee65b1137fe"} Jul 23 18:03:09.536817 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:09.536760 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-49fdv" podStartSLOduration=2.411012699 podStartE2EDuration="5.536741667s" totalImagesPullingTime="3.125728968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:09.536035399 +0000 UTC m=+47.776547076" watchObservedRunningTime="2026-07-23 18:03:09.536741667 +0000 UTC m=+47.777253348" Jul 23 18:03:10.035683 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:10.035636 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:10.035874 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:10.035733 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:10.035874 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:10.035849 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:03:10.035979 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:10.035918 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls podName:a6001d54-1682-46ba-8d87-4d880b4ff470 nodeName:}" failed. No retries permitted until 2026-07-23 18:03:18.035902942 +0000 UTC m=+56.276414600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7mrlv" (UID: "a6001d54-1682-46ba-8d87-4d880b4ff470") : secret "insights-runtime-extractor-tls" not found Jul 23 18:03:10.036188 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:10.036163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a6001d54-1682-46ba-8d87-4d880b4ff470-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:12.454396 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:12.454353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:12.454867 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:12.454478 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:03:12.454867 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:12.454538 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls podName:1cf1a438-fcad-4f8d-9800-5be27aab0e8f nodeName:}" failed. No retries permitted until 2026-07-23 18:03:28.454519287 +0000 UTC m=+66.695030945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls") pod "dns-default-ppgk5" (UID: "1cf1a438-fcad-4f8d-9800-5be27aab0e8f") : secret "dns-default-metrics-tls" not found Jul 23 18:03:14.167356 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:14.167294 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:03:14.167785 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:14.167469 2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:03:14.167785 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:03:14.167547 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert podName:524375a6-795e-4202-9bbb-72a23c296ffa nodeName:}" failed. No retries permitted until 2026-07-23 18:03:30.167526445 +0000 UTC m=+68.408038106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-njhmd" (UID: "524375a6-795e-4202-9bbb-72a23c296ffa") : secret "networking-console-plugin-cert" not found Jul 23 18:03:18.100124 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:18.100082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:18.102633 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:18.102608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a6001d54-1682-46ba-8d87-4d880b4ff470-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7mrlv\" (UID: \"a6001d54-1682-46ba-8d87-4d880b4ff470\") " pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:18.161535 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:18.161509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7mrlv" Jul 23 18:03:18.294110 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:18.294079 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7mrlv"] Jul 23 18:03:18.297791 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:18.297765 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6001d54_1682_46ba_8d87_4d880b4ff470.slice/crio-7cd7b72954ab5053c2faea1515e2de47c22e8d518df13c69cc7fc8c9466265ab WatchSource:0}: Error finding container 7cd7b72954ab5053c2faea1515e2de47c22e8d518df13c69cc7fc8c9466265ab: Status 404 returned error can't find the container with id 7cd7b72954ab5053c2faea1515e2de47c22e8d518df13c69cc7fc8c9466265ab Jul 23 18:03:18.542868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:18.542832 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mrlv" event={"ID":"a6001d54-1682-46ba-8d87-4d880b4ff470","Type":"ContainerStarted","Data":"7cd7b72954ab5053c2faea1515e2de47c22e8d518df13c69cc7fc8c9466265ab"} Jul 23 18:03:23.470834 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:23.469622 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwvxd" Jul 23 18:03:24.559781 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:24.559744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mrlv" event={"ID":"a6001d54-1682-46ba-8d87-4d880b4ff470","Type":"ContainerStarted","Data":"452f259158d7e411e73157d3a1ad8f738ede0da3a7eeb619cdd3deeb567a8296"} Jul 23 18:03:25.236672 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.236633 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp"] Jul 23 18:03:25.238680 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.238650 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l"] Jul 23 18:03:25.238928 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.238908 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.240952 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.240931 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.242101 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.242079 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 18:03:25.242373 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.242357 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 23 18:03:25.242597 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.242580 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 18:03:25.242790 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.242775 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-phqt4\"" Jul 23 18:03:25.243294 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.243275 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 18:03:25.243646 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.243579 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 23 18:03:25.243743 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.243648 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 23 18:03:25.243810 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.243791 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 23 18:03:25.244138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.243951 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 23 18:03:25.252111 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.252057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp"] Jul 23 18:03:25.253141 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.253118 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l"] Jul 23 18:03:25.358625 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358594 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.358827 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358657 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264jx\" (UniqueName: \"kubernetes.io/projected/dd664843-af90-4dc3-b785-edc59a6924e3-kube-api-access-264jx\") pod \"managed-serviceaccount-addon-agent-958b6b8f8-77kqp\" (UID: \"dd664843-af90-4dc3-b785-edc59a6924e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.358827 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-ca\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.358827 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358785 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lldfc\" (UniqueName: \"kubernetes.io/projected/f17f02ab-a721-4874-a214-722dca7cf17d-kube-api-access-lldfc\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.358827 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358808 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd664843-af90-4dc3-b785-edc59a6924e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-958b6b8f8-77kqp\" (UID: \"dd664843-af90-4dc3-b785-edc59a6924e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.358827 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358827 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-hub\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.359098 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358878 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.359098 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.358917 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17f02ab-a721-4874-a214-722dca7cf17d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.460117 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460080 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.460312 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460165 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264jx\" (UniqueName: \"kubernetes.io/projected/dd664843-af90-4dc3-b785-edc59a6924e3-kube-api-access-264jx\") pod \"managed-serviceaccount-addon-agent-958b6b8f8-77kqp\" (UID: \"dd664843-af90-4dc3-b785-edc59a6924e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.460312 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-ca\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.460312 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460230 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lldfc\" (UniqueName: \"kubernetes.io/projected/f17f02ab-a721-4874-a214-722dca7cf17d-kube-api-access-lldfc\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.460312 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460254 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd664843-af90-4dc3-b785-edc59a6924e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-958b6b8f8-77kqp\" (UID: \"dd664843-af90-4dc3-b785-edc59a6924e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.460312 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460280 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-hub\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.460597 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460313 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.460597 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.460373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17f02ab-a721-4874-a214-722dca7cf17d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.461536 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.461108 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f17f02ab-a721-4874-a214-722dca7cf17d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.463905 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.463878 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.464037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.463954 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.464285 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.464240 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-hub\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.464415 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.464365 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dd664843-af90-4dc3-b785-edc59a6924e3-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-958b6b8f8-77kqp\" (UID: \"dd664843-af90-4dc3-b785-edc59a6924e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.464871 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.464852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f17f02ab-a721-4874-a214-722dca7cf17d-ca\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.470385 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.470363 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-264jx\" (UniqueName: \"kubernetes.io/projected/dd664843-af90-4dc3-b785-edc59a6924e3-kube-api-access-264jx\") pod \"managed-serviceaccount-addon-agent-958b6b8f8-77kqp\" (UID: \"dd664843-af90-4dc3-b785-edc59a6924e3\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.470967 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.470948 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lldfc\" (UniqueName: \"kubernetes.io/projected/f17f02ab-a721-4874-a214-722dca7cf17d-kube-api-access-lldfc\") pod \"cluster-proxy-proxy-agent-78fbdf695b-npw5l\" (UID: \"f17f02ab-a721-4874-a214-722dca7cf17d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.563991 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.563901 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" Jul 23 18:03:25.571484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.571453 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" Jul 23 18:03:25.720761 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.720729 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp"] Jul 23 18:03:25.724479 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:25.724449 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd664843_af90_4dc3_b785_edc59a6924e3.slice/crio-75a2070121e7b8004e74a533cdbd546d0b91c0aa8c57ed8a05531a2e3c6b9f98 WatchSource:0}: Error finding container 75a2070121e7b8004e74a533cdbd546d0b91c0aa8c57ed8a05531a2e3c6b9f98: Status 404 returned error can't find the container with id 75a2070121e7b8004e74a533cdbd546d0b91c0aa8c57ed8a05531a2e3c6b9f98 Jul 23 18:03:25.741199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:25.741173 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l"] Jul 23 18:03:25.746999 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:25.746975 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf17f02ab_a721_4874_a214_722dca7cf17d.slice/crio-81150be3340095f8a3ae4ed235c71ec561fe2417d3f1827de123e2785d9b1f2e WatchSource:0}: Error finding container 81150be3340095f8a3ae4ed235c71ec561fe2417d3f1827de123e2785d9b1f2e: Status 404 returned error can't find the container with id 81150be3340095f8a3ae4ed235c71ec561fe2417d3f1827de123e2785d9b1f2e Jul 23 18:03:26.567168 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:26.567127 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" event={"ID":"dd664843-af90-4dc3-b785-edc59a6924e3","Type":"ContainerStarted","Data":"75a2070121e7b8004e74a533cdbd546d0b91c0aa8c57ed8a05531a2e3c6b9f98"} Jul 23 18:03:26.568422 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:26.568394 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" event={"ID":"f17f02ab-a721-4874-a214-722dca7cf17d","Type":"ContainerStarted","Data":"81150be3340095f8a3ae4ed235c71ec561fe2417d3f1827de123e2785d9b1f2e"} Jul 23 18:03:27.074439 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.074409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:03:27.074439 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.074444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:03:27.077342 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.077311 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:03:27.077515 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.077497 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:03:27.086761 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.086738 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/97e7e893-89fd-455e-8475-0a13f62ee46c-original-pull-secret\") pod \"global-pull-secret-syncer-z8kbh\" (UID: \"97e7e893-89fd-455e-8475-0a13f62ee46c\") " pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:03:27.086960 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.086939 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0ddc8e8b-0447-4544-9a4f-94582ab04012-metrics-certs\") pod \"network-metrics-daemon-cpzsh\" (UID: \"0ddc8e8b-0447-4544-9a4f-94582ab04012\") " pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:03:27.174962 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.174924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:03:27.178109 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.178083 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:03:27.188626 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.188597 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:03:27.198990 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.198965 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjtlk\" (UniqueName: \"kubernetes.io/projected/bb63282e-081b-448c-9d99-44973804abd5-kube-api-access-vjtlk\") pod \"network-check-target-hn6bs\" (UID: \"bb63282e-081b-448c-9d99-44973804abd5\") " pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:03:27.273284 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.273253 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqhz\"" Jul 23 18:03:27.279235 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.279208 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdbpx\"" Jul 23 18:03:27.280733 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.280524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cpzsh" Jul 23 18:03:27.282436 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.282373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-z8kbh" Jul 23 18:03:27.287829 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:27.287623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:03:28.485822 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:28.485789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:28.491122 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:28.491055 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1cf1a438-fcad-4f8d-9800-5be27aab0e8f-metrics-tls\") pod \"dns-default-ppgk5\" (UID: \"1cf1a438-fcad-4f8d-9800-5be27aab0e8f\") " pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:28.744551 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:28.744254 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8vl72\"" Jul 23 18:03:28.751461 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:28.751119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:30.198895 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:30.198853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:03:30.201930 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:30.201906 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/524375a6-795e-4202-9bbb-72a23c296ffa-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-njhmd\" (UID: \"524375a6-795e-4202-9bbb-72a23c296ffa\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:03:30.449112 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:30.449035 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-s774g\"" Jul 23 18:03:30.456261 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:30.456236 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" Jul 23 18:03:31.510781 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.510673 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ppgk5"] Jul 23 18:03:31.589225 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.589151 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppgk5" event={"ID":"1cf1a438-fcad-4f8d-9800-5be27aab0e8f","Type":"ContainerStarted","Data":"78ec18e69d5f8718e139d8245cea90cc779571bb17c9dec49a45ff0397b32d62"} Jul 23 18:03:31.592697 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.591966 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" event={"ID":"dd664843-af90-4dc3-b785-edc59a6924e3","Type":"ContainerStarted","Data":"9ceceaab0d7a63838880a80e9e52ca154fa45f6a2130d45cc3a60a6b452a4b48"} Jul 23 18:03:31.595519 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.595486 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mrlv" event={"ID":"a6001d54-1682-46ba-8d87-4d880b4ff470","Type":"ContainerStarted","Data":"00ec117e22122e020af0269c503f3bf84b5d36ced0e2cc6f7c296cec9b35c19c"} Jul 23 18:03:31.602149 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.602093 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd"] Jul 23 18:03:31.608598 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:31.608558 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524375a6_795e_4202_9bbb_72a23c296ffa.slice/crio-26380033224e0496c5710adda4359745ce1eb07c399f840b0a193a0ae30c6b23 WatchSource:0}: Error finding container 26380033224e0496c5710adda4359745ce1eb07c399f840b0a193a0ae30c6b23: Status 404 returned error can't find the container with id 26380033224e0496c5710adda4359745ce1eb07c399f840b0a193a0ae30c6b23 Jul 23 18:03:31.621394 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.620740 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-958b6b8f8-77kqp" podStartSLOduration=0.938789139 podStartE2EDuration="6.620718214s" totalImagesPullingTime="5.681929075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:31.620348176 +0000 UTC m=+69.860859850" watchObservedRunningTime="2026-07-23 18:03:31.620718214 +0000 UTC m=+69.861229895" Jul 23 18:03:31.622520 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.622461 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-z8kbh"] Jul 23 18:03:31.628240 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:31.628218 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97e7e893_89fd_455e_8475_0a13f62ee46c.slice/crio-e40db1bf9d861c7d31118575d40cbdecf340c03e6474b60aada4d5402e6e6f00 WatchSource:0}: Error finding container e40db1bf9d861c7d31118575d40cbdecf340c03e6474b60aada4d5402e6e6f00: Status 404 returned error can't find the container with id e40db1bf9d861c7d31118575d40cbdecf340c03e6474b60aada4d5402e6e6f00 Jul 23 18:03:31.642936 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.642914 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hn6bs"] Jul 23 18:03:31.645778 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:31.645756 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cpzsh"] Jul 23 18:03:31.645972 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:31.645950 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb63282e_081b_448c_9d99_44973804abd5.slice/crio-d60f79391c1ae63450ed9282730a116cd74aa633c94a1cafbe9b1983648bf609 WatchSource:0}: Error finding container d60f79391c1ae63450ed9282730a116cd74aa633c94a1cafbe9b1983648bf609: Status 404 returned error can't find the container with id d60f79391c1ae63450ed9282730a116cd74aa633c94a1cafbe9b1983648bf609 Jul 23 18:03:31.648997 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:31.648937 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddc8e8b_0447_4544_9a4f_94582ab04012.slice/crio-ce03e0e0a4afd469088f6fbe1e68b4fd8cd89288ecb220a758f7a6aa0992c285 WatchSource:0}: Error finding container ce03e0e0a4afd469088f6fbe1e68b4fd8cd89288ecb220a758f7a6aa0992c285: Status 404 returned error can't find the container with id ce03e0e0a4afd469088f6fbe1e68b4fd8cd89288ecb220a758f7a6aa0992c285 Jul 23 18:03:32.604866 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.604764 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpzsh" event={"ID":"0ddc8e8b-0447-4544-9a4f-94582ab04012","Type":"ContainerStarted","Data":"ce03e0e0a4afd469088f6fbe1e68b4fd8cd89288ecb220a758f7a6aa0992c285"} Jul 23 18:03:32.609429 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.608577 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" event={"ID":"f17f02ab-a721-4874-a214-722dca7cf17d","Type":"ContainerStarted","Data":"4f7d86e7a3a25234d90c500e0da756d6f4b8c647f380091583386c189f335928"} Jul 23 18:03:32.609429 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.608617 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" event={"ID":"f17f02ab-a721-4874-a214-722dca7cf17d","Type":"ContainerStarted","Data":"6f5d244f527c3d0e2f3af4f267a33808b5f6d7b3dac8cd32b92567071c797027"} Jul 23 18:03:32.609429 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.608635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" event={"ID":"f17f02ab-a721-4874-a214-722dca7cf17d","Type":"ContainerStarted","Data":"d15cd120391612f5e8d272a83dd2733d9e00c206dac0ab5d003166376c81a927"} Jul 23 18:03:32.611223 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.611147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hn6bs" event={"ID":"bb63282e-081b-448c-9d99-44973804abd5","Type":"ContainerStarted","Data":"d60f79391c1ae63450ed9282730a116cd74aa633c94a1cafbe9b1983648bf609"} Jul 23 18:03:32.614608 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.614544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z8kbh" event={"ID":"97e7e893-89fd-455e-8475-0a13f62ee46c","Type":"ContainerStarted","Data":"e40db1bf9d861c7d31118575d40cbdecf340c03e6474b60aada4d5402e6e6f00"} Jul 23 18:03:32.629371 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.624381 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" event={"ID":"524375a6-795e-4202-9bbb-72a23c296ffa","Type":"ContainerStarted","Data":"26380033224e0496c5710adda4359745ce1eb07c399f840b0a193a0ae30c6b23"} Jul 23 18:03:32.637011 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:32.636228 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-78fbdf695b-npw5l" podStartSLOduration=1.9622759159999998 podStartE2EDuration="7.636209966s" totalImagesPullingTime="5.67393405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:32.634729776 +0000 UTC m=+70.875241458" watchObservedRunningTime="2026-07-23 18:03:32.636209966 +0000 UTC m=+70.876721647" Jul 23 18:03:39.644022 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.643985 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppgk5" event={"ID":"1cf1a438-fcad-4f8d-9800-5be27aab0e8f","Type":"ContainerStarted","Data":"38b610e8d9c7e290861813417d79504ba55a710a2d185e47d19f1a255dfa8b56"} Jul 23 18:03:39.644505 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.644062 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ppgk5" event={"ID":"1cf1a438-fcad-4f8d-9800-5be27aab0e8f","Type":"ContainerStarted","Data":"28a9fc33ed3dcce1e35577c8c5fec37b9a5a832c09694919a0cffeecbf0fe40b"} Jul 23 18:03:39.644505 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.644103 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:39.645550 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.645527 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-z8kbh" event={"ID":"97e7e893-89fd-455e-8475-0a13f62ee46c","Type":"ContainerStarted","Data":"d8809c1f32d13127fd63e5676d3e0fc0ec072595e39e655e862cae3040a763db"} Jul 23 18:03:39.646853 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.646826 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" event={"ID":"524375a6-795e-4202-9bbb-72a23c296ffa","Type":"ContainerStarted","Data":"9dd9373abba9cab411e81f6b3379cdfa4e99ca6823ad6b9c0593aea29b00a248"} Jul 23 18:03:39.648647 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.648628 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7mrlv" event={"ID":"a6001d54-1682-46ba-8d87-4d880b4ff470","Type":"ContainerStarted","Data":"1378deed1f04c103325c025a3416a4d20d30820ba43de1e775dd2f0ad12f36c4"} Jul 23 18:03:39.650303 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.650280 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpzsh" event={"ID":"0ddc8e8b-0447-4544-9a4f-94582ab04012","Type":"ContainerStarted","Data":"a4fac5d20ecfcb07af172dc2b5f6d02075b64354fe52977b23886cbdfb8d4978"} Jul 23 18:03:39.650406 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.650319 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cpzsh" event={"ID":"0ddc8e8b-0447-4544-9a4f-94582ab04012","Type":"ContainerStarted","Data":"0c8eb434f7beac091098b7efe61f0cbffd977bf48fb824e0bf5b687e8c5c49e8"} Jul 23 18:03:39.651649 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.651630 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hn6bs" event={"ID":"bb63282e-081b-448c-9d99-44973804abd5","Type":"ContainerStarted","Data":"628e960344d2d8790043abdc5dedd1e740e66ba4c535581e95ad435bfc15191f"} Jul 23 18:03:39.651769 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.651755 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:03:39.663979 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.663925 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ppgk5" podStartSLOduration=36.524075625 podStartE2EDuration="43.663913277s" totalImagesPullingTime="7.139837652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:39.662842127 +0000 UTC m=+77.903353808" watchObservedRunningTime="2026-07-23 18:03:39.663913277 +0000 UTC m=+77.904424935" Jul 23 18:03:39.677466 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.677423 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-njhmd" podStartSLOduration=34.625046918 podStartE2EDuration="41.677405235s" totalImagesPullingTime="7.052358317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:39.676924897 +0000 UTC m=+77.917436577" watchObservedRunningTime="2026-07-23 18:03:39.677405235 +0000 UTC m=+77.917916920" Jul 23 18:03:39.693644 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.693600 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cpzsh" podStartSLOduration=72.127635784 podStartE2EDuration="1m17.693582911s" totalImagesPullingTime="5.565947127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:39.692554277 +0000 UTC m=+77.933065960" watchObservedRunningTime="2026-07-23 18:03:39.693582911 +0000 UTC m=+77.934094593" Jul 23 18:03:39.710658 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.710619 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hn6bs" podStartSLOduration=70.683839001 podStartE2EDuration="1m17.710607344s" totalImagesPullingTime="7.026768343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:39.709982668 +0000 UTC m=+77.950494348" watchObservedRunningTime="2026-07-23 18:03:39.710607344 +0000 UTC m=+77.951119020" Jul 23 18:03:39.725186 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.725144 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-z8kbh" podStartSLOduration=70.671046839 podStartE2EDuration="1m17.725130706s" totalImagesPullingTime="7.054083867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:02:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:39.725035465 +0000 UTC m=+77.965547152" watchObservedRunningTime="2026-07-23 18:03:39.725130706 +0000 UTC m=+77.965642386" Jul 23 18:03:39.745428 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:39.745356 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7mrlv" podStartSLOduration=17.639677158 podStartE2EDuration="37.745319778s" totalImagesPullingTime="20.10564262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:03:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:39.745156586 +0000 UTC m=+77.985668266" watchObservedRunningTime="2026-07-23 18:03:39.745319778 +0000 UTC m=+77.985831459" Jul 23 18:03:49.657469 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:49.657310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ppgk5" Jul 23 18:03:53.367506 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.367469 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7trkx"] Jul 23 18:03:53.374815 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.374784 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.377450 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.377401 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fxzht\"" Jul 23 18:03:53.377584 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.377402 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 18:03:53.377812 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.377796 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 18:03:53.378772 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.378573 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 18:03:53.378772 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.378609 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 18:03:53.378772 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.378609 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 18:03:53.378772 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.378605 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 18:03:53.473678 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473649 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsrpf\" (UniqueName: \"kubernetes.io/projected/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-kube-api-access-gsrpf\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.473861 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473688 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-root\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.473861 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473712 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-tls\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.473861 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473804 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-accelerators-collector-config\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.473861 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-sys\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.474064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.474064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-metrics-client-ca\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.474064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473954 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-textfile\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.474064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.473983 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-wtmp\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.574782 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.574747 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-textfile\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.574782 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.574794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-wtmp\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.574916 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsrpf\" (UniqueName: \"kubernetes.io/projected/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-kube-api-access-gsrpf\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.574944 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-wtmp\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.574962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-root\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575001 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-root\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575008 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-tls\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-accelerators-collector-config\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-sys\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575090 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575116 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-metrics-client-ca\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575157 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-sys\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575573 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575555 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-textfile\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.575743 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.575721 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-accelerators-collector-config\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.576028 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.576008 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-metrics-client-ca\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.577575 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.577541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.577797 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.577781 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-node-exporter-tls\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.584307 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.584285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsrpf\" (UniqueName: \"kubernetes.io/projected/59f57fe5-e5bf-46a1-9c29-dd7982ae4d40-kube-api-access-gsrpf\") pod \"node-exporter-7trkx\" (UID: \"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40\") " pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.685221 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:53.685144 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7trkx" Jul 23 18:03:53.704361 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:03:53.704314 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f57fe5_e5bf_46a1_9c29_dd7982ae4d40.slice/crio-0c00857ce00d78424debea5b076ab5f559d3b953f268771f905f4fef08529dd4 WatchSource:0}: Error finding container 0c00857ce00d78424debea5b076ab5f559d3b953f268771f905f4fef08529dd4: Status 404 returned error can't find the container with id 0c00857ce00d78424debea5b076ab5f559d3b953f268771f905f4fef08529dd4 Jul 23 18:03:54.703067 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:54.703021 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7trkx" event={"ID":"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40","Type":"ContainerStarted","Data":"0c00857ce00d78424debea5b076ab5f559d3b953f268771f905f4fef08529dd4"} Jul 23 18:03:55.708868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:55.708833 2580 generic.go:356] "Generic (PLEG): container finished" podID="59f57fe5-e5bf-46a1-9c29-dd7982ae4d40" containerID="98d2160461624b4c2c9528c5491c78cbb80d36d3017f9fe0c4587431a05a2ac3" exitCode=0 Jul 23 18:03:55.709252 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:55.708912 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7trkx" event={"ID":"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40","Type":"ContainerDied","Data":"98d2160461624b4c2c9528c5491c78cbb80d36d3017f9fe0c4587431a05a2ac3"} Jul 23 18:03:56.717701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:56.717661 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7trkx" event={"ID":"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40","Type":"ContainerStarted","Data":"c002b9587adbbf742c6ec837e431b08f1decf3ac8dea9bfd604aa9e43367fdb2"} Jul 23 18:03:56.718078 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:56.717744 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7trkx" event={"ID":"59f57fe5-e5bf-46a1-9c29-dd7982ae4d40","Type":"ContainerStarted","Data":"4cdb211ab8e3c705fa58e5eb14007470bab8ba129622b38a75764c8b7959008f"} Jul 23 18:03:56.742987 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:03:56.742936 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7trkx" podStartSLOduration=2.075879998 podStartE2EDuration="3.74292158s" totalImagesPullingTime="1.568625403s" totalInitContainerRuntime="98.416179ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:03:56.741035614 +0000 UTC m=+94.981547295" watchObservedRunningTime="2026-07-23 18:03:56.74292158 +0000 UTC m=+94.983433259" Jul 23 18:04:10.657987 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:04:10.657956 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hn6bs" Jul 23 18:07:22.166058 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:22.166009 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 18:07:30.373632 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.373598 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hbx95"] Jul 23 18:07:30.375661 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.375645 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.378169 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.378144 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4dkkk\"" Jul 23 18:07:30.378169 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.378157 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 18:07:30.379238 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.379224 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 18:07:30.385657 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.385636 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hbx95"] Jul 23 18:07:30.455541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.455512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp9fx\" (UniqueName: \"kubernetes.io/projected/f40e4a20-6970-4ab8-85d7-bfecf55b7415-kube-api-access-sp9fx\") pod \"cert-manager-webhook-6486ffd997-hbx95\" (UID: \"f40e4a20-6970-4ab8-85d7-bfecf55b7415\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.455687 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.455548 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f40e4a20-6970-4ab8-85d7-bfecf55b7415-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hbx95\" (UID: \"f40e4a20-6970-4ab8-85d7-bfecf55b7415\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.556510 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.556470 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f40e4a20-6970-4ab8-85d7-bfecf55b7415-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hbx95\" (UID: \"f40e4a20-6970-4ab8-85d7-bfecf55b7415\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.556690 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.556548 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp9fx\" (UniqueName: \"kubernetes.io/projected/f40e4a20-6970-4ab8-85d7-bfecf55b7415-kube-api-access-sp9fx\") pod \"cert-manager-webhook-6486ffd997-hbx95\" (UID: \"f40e4a20-6970-4ab8-85d7-bfecf55b7415\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.565311 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.565277 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f40e4a20-6970-4ab8-85d7-bfecf55b7415-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-hbx95\" (UID: \"f40e4a20-6970-4ab8-85d7-bfecf55b7415\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.565503 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.565485 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp9fx\" (UniqueName: \"kubernetes.io/projected/f40e4a20-6970-4ab8-85d7-bfecf55b7415-kube-api-access-sp9fx\") pod \"cert-manager-webhook-6486ffd997-hbx95\" (UID: \"f40e4a20-6970-4ab8-85d7-bfecf55b7415\") " pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.684321 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.684228 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:30.811507 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.811470 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-hbx95"] Jul 23 18:07:30.813950 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:07:30.813925 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf40e4a20_6970_4ab8_85d7_bfecf55b7415.slice/crio-bbe4cc385f9688abc2477173a78300fce2562f4d32b09406d3cf5ee997edac35 WatchSource:0}: Error finding container bbe4cc385f9688abc2477173a78300fce2562f4d32b09406d3cf5ee997edac35: Status 404 returned error can't find the container with id bbe4cc385f9688abc2477173a78300fce2562f4d32b09406d3cf5ee997edac35 Jul 23 18:07:30.815865 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:30.815847 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:07:31.431190 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:31.431151 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" event={"ID":"f40e4a20-6970-4ab8-85d7-bfecf55b7415","Type":"ContainerStarted","Data":"bbe4cc385f9688abc2477173a78300fce2562f4d32b09406d3cf5ee997edac35"} Jul 23 18:07:35.447610 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:35.447570 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" event={"ID":"f40e4a20-6970-4ab8-85d7-bfecf55b7415","Type":"ContainerStarted","Data":"5f597dcf10bd31a9bc5fa31a95d818f79b367df23132d0e46116373eeb814469"} Jul 23 18:07:35.447964 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:35.447808 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:07:35.466828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:35.466780 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" podStartSLOduration=1.8671560999999999 podStartE2EDuration="5.466741917s" totalImagesPullingTime="3.599585817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:35.465551732 +0000 UTC m=+313.706063412" watchObservedRunningTime="2026-07-23 18:07:35.466741917 +0000 UTC m=+313.707253597" Jul 23 18:07:41.453493 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:07:41.453458 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-hbx95" Jul 23 18:08:09.989230 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.989199 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv"] Jul 23 18:08:09.993530 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.993513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:09.996542 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.996514 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 18:08:09.996693 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.996561 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:08:09.997791 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.997765 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 18:08:09.997906 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.997803 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 18:08:09.997906 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.997859 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 18:08:09.997986 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:09.997967 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pjf62\"" Jul 23 18:08:10.008392 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.008371 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv"] Jul 23 18:08:10.137736 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.137701 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-manager-config\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.137907 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.137744 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s8gw\" (UniqueName: \"kubernetes.io/projected/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-kube-api-access-8s8gw\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.137907 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.137776 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-cert\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.137907 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.137840 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-metrics-cert\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.238971 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.238939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-cert\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.239131 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.238990 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-metrics-cert\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.239131 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.239021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-manager-config\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.239131 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.239056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s8gw\" (UniqueName: \"kubernetes.io/projected/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-kube-api-access-8s8gw\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.239805 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.239749 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-manager-config\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.241654 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.241632 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-metrics-cert\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.241733 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.241696 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-cert\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.255651 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.255631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s8gw\" (UniqueName: \"kubernetes.io/projected/58bd3c6b-7656-42fb-b489-c4677a9e3a3e-kube-api-access-8s8gw\") pod \"lws-controller-manager-689d89c9b7-4nvvv\" (UID: \"58bd3c6b-7656-42fb-b489-c4677a9e3a3e\") " pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.302499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.302471 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:10.441724 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.441695 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv"] Jul 23 18:08:10.444034 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:08:10.444001 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bd3c6b_7656_42fb_b489_c4677a9e3a3e.slice/crio-5a198ad36dab77c135c1f545ef7384cab612126bb514d7ac62d1b4e83ce2305f WatchSource:0}: Error finding container 5a198ad36dab77c135c1f545ef7384cab612126bb514d7ac62d1b4e83ce2305f: Status 404 returned error can't find the container with id 5a198ad36dab77c135c1f545ef7384cab612126bb514d7ac62d1b4e83ce2305f Jul 23 18:08:10.561051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:10.560959 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" event={"ID":"58bd3c6b-7656-42fb-b489-c4677a9e3a3e","Type":"ContainerStarted","Data":"5a198ad36dab77c135c1f545ef7384cab612126bb514d7ac62d1b4e83ce2305f"} Jul 23 18:08:12.569415 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:12.569372 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" event={"ID":"58bd3c6b-7656-42fb-b489-c4677a9e3a3e","Type":"ContainerStarted","Data":"d120ed82aaad29a05cd27812a7922a6855f8251804f3b78ddea3ed2dfbd808ea"} Jul 23 18:08:12.569818 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:12.569554 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:12.596871 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:12.596817 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" podStartSLOduration=1.605454807 podStartE2EDuration="3.596797859s" totalImagesPullingTime="1.991343052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:12.595486589 +0000 UTC m=+350.835998270" watchObservedRunningTime="2026-07-23 18:08:12.596797859 +0000 UTC m=+350.837309542" Jul 23 18:08:14.052421 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.052343 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg"] Jul 23 18:08:14.055347 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.055313 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.058214 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.058192 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 18:08:14.058475 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.058455 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 18:08:14.058475 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.058469 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kfsfm\"" Jul 23 18:08:14.058616 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.058499 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 18:08:14.058616 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.058508 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 18:08:14.071323 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.071298 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg"] Jul 23 18:08:14.170745 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.170704 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4eac455f-2366-478c-9019-53913c1300d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.170945 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.170763 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4eac455f-2366-478c-9019-53913c1300d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.170945 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.170786 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4eac455f-2366-478c-9019-53913c1300d4-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.170945 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.170834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eac455f-2366-478c-9019-53913c1300d4-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.170945 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.170854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttdx7\" (UniqueName: \"kubernetes.io/projected/4eac455f-2366-478c-9019-53913c1300d4-kube-api-access-ttdx7\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.272124 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.272089 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4eac455f-2366-478c-9019-53913c1300d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.272124 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.272123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4eac455f-2366-478c-9019-53913c1300d4-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.272369 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.272154 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eac455f-2366-478c-9019-53913c1300d4-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.272369 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.272174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttdx7\" (UniqueName: \"kubernetes.io/projected/4eac455f-2366-478c-9019-53913c1300d4-kube-api-access-ttdx7\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.272369 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.272310 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4eac455f-2366-478c-9019-53913c1300d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.272555 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.272537 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4eac455f-2366-478c-9019-53913c1300d4-manifests\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.274629 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.274597 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eac455f-2366-478c-9019-53913c1300d4-tmp\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.274803 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.274784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4eac455f-2366-478c-9019-53913c1300d4-webhook-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.274862 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.274819 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4eac455f-2366-478c-9019-53913c1300d4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.281534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.281511 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttdx7\" (UniqueName: \"kubernetes.io/projected/4eac455f-2366-478c-9019-53913c1300d4-kube-api-access-ttdx7\") pod \"opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg\" (UID: \"4eac455f-2366-478c-9019-53913c1300d4\") " pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.365548 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.365468 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:14.511864 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.511840 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg"] Jul 23 18:08:14.514423 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:08:14.514380 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eac455f_2366_478c_9019_53913c1300d4.slice/crio-a06a0c2eff52e8d835d4a790cb76d259529e9bfb10b9619a045d3d1cbdfcb203 WatchSource:0}: Error finding container a06a0c2eff52e8d835d4a790cb76d259529e9bfb10b9619a045d3d1cbdfcb203: Status 404 returned error can't find the container with id a06a0c2eff52e8d835d4a790cb76d259529e9bfb10b9619a045d3d1cbdfcb203 Jul 23 18:08:14.577473 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:14.577439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" event={"ID":"4eac455f-2366-478c-9019-53913c1300d4","Type":"ContainerStarted","Data":"a06a0c2eff52e8d835d4a790cb76d259529e9bfb10b9619a045d3d1cbdfcb203"} Jul 23 18:08:18.593874 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:18.593835 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" event={"ID":"4eac455f-2366-478c-9019-53913c1300d4","Type":"ContainerStarted","Data":"a65bc38bfa23c9412114f7a5e79e27f0f8291cdf788bcd5d132ff7d3e2dabc92"} Jul 23 18:08:19.600808 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:19.600772 2580 generic.go:356] "Generic (PLEG): container finished" podID="4eac455f-2366-478c-9019-53913c1300d4" containerID="a65bc38bfa23c9412114f7a5e79e27f0f8291cdf788bcd5d132ff7d3e2dabc92" exitCode=0 Jul 23 18:08:19.601216 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:19.600851 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" event={"ID":"4eac455f-2366-478c-9019-53913c1300d4","Type":"ContainerDied","Data":"a65bc38bfa23c9412114f7a5e79e27f0f8291cdf788bcd5d132ff7d3e2dabc92"} Jul 23 18:08:20.605984 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:20.605945 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" event={"ID":"4eac455f-2366-478c-9019-53913c1300d4","Type":"ContainerStarted","Data":"1332dfbbc1fed8e6b9590f5266096ad551bd8b3c2396f9db45da0d0b23e47a13"} Jul 23 18:08:20.606501 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:20.606083 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:20.640545 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:20.640491 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" podStartSLOduration=2.123993707 podStartE2EDuration="6.640470543s" totalImagesPullingTime="3.426286002s" totalInitContainerRuntime="1.090190834s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:20.639275076 +0000 UTC m=+358.879786766" watchObservedRunningTime="2026-07-23 18:08:20.640470543 +0000 UTC m=+358.880982223" Jul 23 18:08:23.574352 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:23.574294 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-689d89c9b7-4nvvv" Jul 23 18:08:31.611282 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:31.611254 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg" Jul 23 18:08:46.374308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.374273 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89"] Jul 23 18:08:46.377717 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.377699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.380943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.380921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 18:08:46.381061 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.380919 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x9k9x\"" Jul 23 18:08:46.381219 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.381202 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 18:08:46.381268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.381202 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 23 18:08:46.390789 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.390762 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89"] Jul 23 18:08:46.407504 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407614 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407614 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407573 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407682 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407682 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xxlz\" (UniqueName: \"kubernetes.io/projected/5b4e9c4b-bef9-479a-88a6-5e1b28153445-kube-api-access-6xxlz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407754 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407706 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407754 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407736 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407824 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407760 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.407824 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.407781 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508432 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508397 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508631 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xxlz\" (UniqueName: \"kubernetes.io/projected/5b4e9c4b-bef9-479a-88a6-5e1b28153445-kube-api-access-6xxlz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508631 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508631 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508486 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508631 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508849 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508631 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508849 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508671 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508849 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508717 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.508849 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.508755 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.509101 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.509077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.509222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.509109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.509222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.509171 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.509312 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.509231 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.509312 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.509257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.511172 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.511144 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.511270 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.511202 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.524814 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.524782 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b4e9c4b-bef9-479a-88a6-5e1b28153445-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.529146 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.529112 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xxlz\" (UniqueName: \"kubernetes.io/projected/5b4e9c4b-bef9-479a-88a6-5e1b28153445-kube-api-access-6xxlz\") pod \"data-science-gateway-data-science-gateway-class-6576859cf48lb89\" (UID: \"5b4e9c4b-bef9-479a-88a6-5e1b28153445\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.654750 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.654667 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4"] Jul 23 18:08:46.658902 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.658884 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.661946 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.661921 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 23 18:08:46.661946 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.661943 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 23 18:08:46.662170 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.662159 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 23 18:08:46.662233 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.662190 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-blnlh\"" Jul 23 18:08:46.675243 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.675219 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4"] Jul 23 18:08:46.687486 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.687467 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:46.710070 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.710038 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.710178 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.710096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.710178 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.710128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.710288 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.710175 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s77q\" (UniqueName: \"kubernetes.io/projected/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-kube-api-access-2s77q\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.710288 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.710215 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.710288 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.710283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.710456 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.710353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.810979 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.810948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.810979 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.810986 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.811244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.811164 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.811244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.811196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.811244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.811224 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s77q\" (UniqueName: \"kubernetes.io/projected/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-kube-api-access-2s77q\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.811410 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.811273 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.811410 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.811358 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.812273 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.812243 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.813638 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.813610 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.813802 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.813780 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.813895 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.813875 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.813961 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.813946 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.828768 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.828742 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s77q\" (UniqueName: \"kubernetes.io/projected/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-kube-api-access-2s77q\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.828864 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.828852 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b3ba082-91f8-4751-a8d6-bf413b6f8c95-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-s6tl4\" (UID: \"0b3ba082-91f8-4751-a8d6-bf413b6f8c95\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:46.841496 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.841470 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89"] Jul 23 18:08:46.842924 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:08:46.842896 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b4e9c4b_bef9_479a_88a6_5e1b28153445.slice/crio-6c8ccc103b396b1c78d930e23acaa69d7c5c24ffa603b9810c12f0c0cd07fa5b WatchSource:0}: Error finding container 6c8ccc103b396b1c78d930e23acaa69d7c5c24ffa603b9810c12f0c0cd07fa5b: Status 404 returned error can't find the container with id 6c8ccc103b396b1c78d930e23acaa69d7c5c24ffa603b9810c12f0c0cd07fa5b Jul 23 18:08:46.969879 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:46.969796 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:47.110782 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:47.110748 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4"] Jul 23 18:08:47.114027 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:08:47.113997 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b3ba082_91f8_4751_a8d6_bf413b6f8c95.slice/crio-e91018adad045b15c14cd5b03a8dd62801a08b76def5a3ad73e0dad0aa049006 WatchSource:0}: Error finding container e91018adad045b15c14cd5b03a8dd62801a08b76def5a3ad73e0dad0aa049006: Status 404 returned error can't find the container with id e91018adad045b15c14cd5b03a8dd62801a08b76def5a3ad73e0dad0aa049006 Jul 23 18:08:47.708649 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:47.708611 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" event={"ID":"5b4e9c4b-bef9-479a-88a6-5e1b28153445","Type":"ContainerStarted","Data":"6c8ccc103b396b1c78d930e23acaa69d7c5c24ffa603b9810c12f0c0cd07fa5b"} Jul 23 18:08:47.709775 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:47.709748 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" event={"ID":"0b3ba082-91f8-4751-a8d6-bf413b6f8c95","Type":"ContainerStarted","Data":"e91018adad045b15c14cd5b03a8dd62801a08b76def5a3ad73e0dad0aa049006"} Jul 23 18:08:50.668517 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:50.668476 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:08:50.668880 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:50.668559 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:08:50.671523 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:50.671496 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:08:50.671607 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:50.671558 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:08:50.671607 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:50.671588 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:08:51.728517 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:51.728479 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" event={"ID":"0b3ba082-91f8-4751-a8d6-bf413b6f8c95","Type":"ContainerStarted","Data":"dafd00afee24329c7ae6ab3e50b6f025128e6502dd953978c9a38c38f3e7dc88"} Jul 23 18:08:51.728975 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:51.728545 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:51.730360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:51.730306 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" event={"ID":"5b4e9c4b-bef9-479a-88a6-5e1b28153445","Type":"ContainerStarted","Data":"fc3e77ca299db9e22d407ddc744147273e4a62fae3138ae02d0229ae67feb441"} Jul 23 18:08:51.731547 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:51.731204 2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-s6tl4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 18:08:51.731547 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:51.731274 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" podUID="0b3ba082-91f8-4751-a8d6-bf413b6f8c95" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 18:08:52.008105 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:52.008050 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" podStartSLOduration=2.181522659 podStartE2EDuration="6.00803178s" totalImagesPullingTime="3.826509121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:52.008029744 +0000 UTC m=+390.248541424" watchObservedRunningTime="2026-07-23 18:08:52.00803178 +0000 UTC m=+390.248543460" Jul 23 18:08:52.008297 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:52.008162 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" podStartSLOduration=2.455965341 podStartE2EDuration="6.008154059s" totalImagesPullingTime="3.552188718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:51.905837283 +0000 UTC m=+390.146348963" watchObservedRunningTime="2026-07-23 18:08:52.008154059 +0000 UTC m=+390.248665738" Jul 23 18:08:52.688054 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:52.688016 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:52.692494 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:52.692472 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:52.734209 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:52.734176 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:08:52.734974 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:52.734951 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-s6tl4" Jul 23 18:08:52.735297 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:08:52.735281 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf48lb89" Jul 23 18:11:46.994434 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:46.994400 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2"] Jul 23 18:11:46.996433 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:46.996416 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.005216 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.005194 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-9d98w\"" Jul 23 18:11:47.005477 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.005464 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 23 18:11:47.006448 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.006435 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 23 18:11:47.024525 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.024495 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 23 18:11:47.038235 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.038204 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2"] Jul 23 18:11:47.051352 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.051303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9fqb\" (UniqueName: \"kubernetes.io/projected/20508d9c-520f-4763-bbaf-1c7120014d8f-kube-api-access-d9fqb\") pod \"postgres-69fb4594cf-cnqw2\" (UID: \"20508d9c-520f-4763-bbaf-1c7120014d8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.051500 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.051433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20508d9c-520f-4763-bbaf-1c7120014d8f-data\") pod \"postgres-69fb4594cf-cnqw2\" (UID: \"20508d9c-520f-4763-bbaf-1c7120014d8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.152617 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.152577 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20508d9c-520f-4763-bbaf-1c7120014d8f-data\") pod \"postgres-69fb4594cf-cnqw2\" (UID: \"20508d9c-520f-4763-bbaf-1c7120014d8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.152805 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.152636 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9fqb\" (UniqueName: \"kubernetes.io/projected/20508d9c-520f-4763-bbaf-1c7120014d8f-kube-api-access-d9fqb\") pod \"postgres-69fb4594cf-cnqw2\" (UID: \"20508d9c-520f-4763-bbaf-1c7120014d8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.152987 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.152963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20508d9c-520f-4763-bbaf-1c7120014d8f-data\") pod \"postgres-69fb4594cf-cnqw2\" (UID: \"20508d9c-520f-4763-bbaf-1c7120014d8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.167142 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.167114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9fqb\" (UniqueName: \"kubernetes.io/projected/20508d9c-520f-4763-bbaf-1c7120014d8f-kube-api-access-d9fqb\") pod \"postgres-69fb4594cf-cnqw2\" (UID: \"20508d9c-520f-4763-bbaf-1c7120014d8f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.306731 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.306653 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:47.436729 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:47.436607 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2"] Jul 23 18:11:47.439197 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:11:47.439170 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20508d9c_520f_4763_bbaf_1c7120014d8f.slice/crio-1aeefd65617d7ee90c2e03108340c7dbf8d014bc7279fad2272d46d378f253b5 WatchSource:0}: Error finding container 1aeefd65617d7ee90c2e03108340c7dbf8d014bc7279fad2272d46d378f253b5: Status 404 returned error can't find the container with id 1aeefd65617d7ee90c2e03108340c7dbf8d014bc7279fad2272d46d378f253b5 Jul 23 18:11:48.365091 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:48.365034 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" event={"ID":"20508d9c-520f-4763-bbaf-1c7120014d8f","Type":"ContainerStarted","Data":"1aeefd65617d7ee90c2e03108340c7dbf8d014bc7279fad2272d46d378f253b5"} Jul 23 18:11:52.384572 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:52.384530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" event={"ID":"20508d9c-520f-4763-bbaf-1c7120014d8f","Type":"ContainerStarted","Data":"b6358d60bfa8b0abdc05cb81bb8360c2aa9bf695b1f1ff638650acc89511a6a5"} Jul 23 18:11:52.384944 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:52.384628 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:11:52.403423 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:52.403376 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" podStartSLOduration=1.570472549 podStartE2EDuration="6.403361723s" totalImagesPullingTime="4.832889174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:52.402934431 +0000 UTC m=+570.643446113" watchObservedRunningTime="2026-07-23 18:11:52.403361723 +0000 UTC m=+570.643873407" Jul 23 18:11:58.418845 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:11:58.418815 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-cnqw2" Jul 23 18:13:14.999108 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:14.999018 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f"] Jul 23 18:13:15.002301 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.002279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.005156 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.005126 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 23 18:13:15.005296 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.005163 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 23 18:13:15.005296 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.005213 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 23 18:13:15.006111 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.006092 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8jklp\"" Jul 23 18:13:15.017019 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.016988 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f"] Jul 23 18:13:15.062177 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.062140 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.062177 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.062179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.062436 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.062222 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8865f0d-d90f-4e8b-a182-5bd207879c8f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.062436 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.062279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.062436 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.062415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxjqh\" (UniqueName: \"kubernetes.io/projected/b8865f0d-d90f-4e8b-a182-5bd207879c8f-kube-api-access-vxjqh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.062552 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.062453 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.163570 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.163521 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxjqh\" (UniqueName: \"kubernetes.io/projected/b8865f0d-d90f-4e8b-a182-5bd207879c8f-kube-api-access-vxjqh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.163570 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.163575 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.163821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.163601 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.163821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.163616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.163821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.163643 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8865f0d-d90f-4e8b-a182-5bd207879c8f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.163821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.163663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.164056 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.164038 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.164056 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.164043 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.164160 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.164084 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.166082 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.166066 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b8865f0d-d90f-4e8b-a182-5bd207879c8f-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.166324 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.166306 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8865f0d-d90f-4e8b-a182-5bd207879c8f-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.173103 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.173079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxjqh\" (UniqueName: \"kubernetes.io/projected/b8865f0d-d90f-4e8b-a182-5bd207879c8f-kube-api-access-vxjqh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kzb4f\" (UID: \"b8865f0d-d90f-4e8b-a182-5bd207879c8f\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.312415 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.312316 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:15.461554 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.461520 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f"] Jul 23 18:13:15.464472 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:13:15.464439 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8865f0d_d90f_4e8b_a182_5bd207879c8f.slice/crio-390d0b79592b30b3ee12cef62418ea4aa07f83d5692b838a5300dc7c6d6696b8 WatchSource:0}: Error finding container 390d0b79592b30b3ee12cef62418ea4aa07f83d5692b838a5300dc7c6d6696b8: Status 404 returned error can't find the container with id 390d0b79592b30b3ee12cef62418ea4aa07f83d5692b838a5300dc7c6d6696b8 Jul 23 18:13:15.465752 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.465731 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:13:15.717381 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:15.717273 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" event={"ID":"b8865f0d-d90f-4e8b-a182-5bd207879c8f","Type":"ContainerStarted","Data":"390d0b79592b30b3ee12cef62418ea4aa07f83d5692b838a5300dc7c6d6696b8"} Jul 23 18:13:16.723688 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:16.723657 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" event={"ID":"b8865f0d-d90f-4e8b-a182-5bd207879c8f","Type":"ContainerStarted","Data":"72478f1c11d0808ce1d2d42f4185990c99e339dcb99e6fe1dcab921f874a2c6b"} Jul 23 18:13:16.745321 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:16.745214 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" podStartSLOduration=1.717281888 podStartE2EDuration="2.745196927s" totalImagesPullingTime="1.027915039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:13:16.74358745 +0000 UTC m=+654.984099132" watchObservedRunningTime="2026-07-23 18:13:16.745196927 +0000 UTC m=+654.985708625" Jul 23 18:13:25.312830 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:25.312792 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:25.313224 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:25.312864 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:25.325459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:25.325430 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:25.770308 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:25.770280 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kzb4f" Jul 23 18:13:26.806926 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.806894 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69"] Jul 23 18:13:26.810125 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.810106 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:26.813034 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.813016 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 23 18:13:26.823117 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.823097 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69"] Jul 23 18:13:26.955069 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.955034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:26.955069 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.955085 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:26.955360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.955111 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/177591a6-d1f4-4abc-a4db-b8e185a1138e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:26.955360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.955194 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7npsq\" (UniqueName: \"kubernetes.io/projected/177591a6-d1f4-4abc-a4db-b8e185a1138e-kube-api-access-7npsq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:26.955360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.955260 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:26.955360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:26.955283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056458 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056418 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056458 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056457 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056481 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056610 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/177591a6-d1f4-4abc-a4db-b8e185a1138e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7npsq\" (UniqueName: \"kubernetes.io/projected/177591a6-d1f4-4abc-a4db-b8e185a1138e-kube-api-access-7npsq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056906 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056874 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056987 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056923 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.056987 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.056958 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.058825 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.058804 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/177591a6-d1f4-4abc-a4db-b8e185a1138e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.059214 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.059197 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/177591a6-d1f4-4abc-a4db-b8e185a1138e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.066696 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.066675 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7npsq\" (UniqueName: \"kubernetes.io/projected/177591a6-d1f4-4abc-a4db-b8e185a1138e-kube-api-access-7npsq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69\" (UID: \"177591a6-d1f4-4abc-a4db-b8e185a1138e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.120505 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.120463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:27.253957 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.253933 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69"] Jul 23 18:13:27.256350 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:13:27.256312 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177591a6_d1f4_4abc_a4db_b8e185a1138e.slice/crio-88b69c6341a96a488ac40046f4a7b8796007331a0009cb9ec0a9acedb1b1bf8a WatchSource:0}: Error finding container 88b69c6341a96a488ac40046f4a7b8796007331a0009cb9ec0a9acedb1b1bf8a: Status 404 returned error can't find the container with id 88b69c6341a96a488ac40046f4a7b8796007331a0009cb9ec0a9acedb1b1bf8a Jul 23 18:13:27.768549 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.768516 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" event={"ID":"177591a6-d1f4-4abc-a4db-b8e185a1138e","Type":"ContainerStarted","Data":"aeedcc9cbbc62281878623b8c06955c50d857832871753942ed60f52a526bc61"} Jul 23 18:13:27.768719 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.768567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" event={"ID":"177591a6-d1f4-4abc-a4db-b8e185a1138e","Type":"ContainerStarted","Data":"88b69c6341a96a488ac40046f4a7b8796007331a0009cb9ec0a9acedb1b1bf8a"} Jul 23 18:13:27.791917 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:27.791862 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" podStartSLOduration=1.589790016 podStartE2EDuration="1.791846339s" totalImagesPullingTime="202.056323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:13:27.789942653 +0000 UTC m=+666.030454334" watchObservedRunningTime="2026-07-23 18:13:27.791846339 +0000 UTC m=+666.032358020" Jul 23 18:13:37.120734 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:37.120694 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:37.121206 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:37.120772 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:37.133104 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:37.133074 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:13:37.824900 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:13:37.824865 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69" Jul 23 18:30:44.115902 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.115823 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d"] Jul 23 18:30:44.119167 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.119150 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.122112 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.122091 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a922dc39-openshift-default-dockercfg-wqfzk\"" Jul 23 18:30:44.134083 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.134061 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d"] Jul 23 18:30:44.172846 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.172817 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-podinfo\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.172846 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.172849 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrrfv\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-kube-api-access-xrrfv\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.173063 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.172869 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-data\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.173063 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.172914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-certs\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.173063 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.172944 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5a05f24-0c0d-4767-bff7-7b7cee275438-istiod-ca-cert\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.173063 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.173005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-token\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.173230 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.173060 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-envoy\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.173230 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.173092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-socket\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.173230 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.173119 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-credential-socket\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.273954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.273913 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-envoy\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.273954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.273957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-socket\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.273984 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-credential-socket\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274040 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-podinfo\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274063 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrrfv\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-kube-api-access-xrrfv\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274383 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274214 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-data\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274383 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274351 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-socket\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274383 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274375 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-certs\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274552 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5a05f24-0c0d-4767-bff7-7b7cee275438-istiod-ca-cert\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274552 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-token\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274654 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274588 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-data\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274706 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274665 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-certs\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.274746 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274699 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-credential-socket\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.275016 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.274991 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5a05f24-0c0d-4767-bff7-7b7cee275438-istiod-ca-cert\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.276483 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.276465 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-envoy\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.276931 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.276915 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-podinfo\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.284391 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.284369 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-token\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.284497 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.284369 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrrfv\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-kube-api-access-xrrfv\") pod \"e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.429463 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.429379 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:44.570051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.570023 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d"] Jul 23 18:30:44.572011 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:30:44.571981 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a05f24_0c0d_4767_bff7_7b7cee275438.slice/crio-40ea0b6c158b15776611c10bf11849ff962b50e013948a8c050d620e2f48ae34 WatchSource:0}: Error finding container 40ea0b6c158b15776611c10bf11849ff962b50e013948a8c050d620e2f48ae34: Status 404 returned error can't find the container with id 40ea0b6c158b15776611c10bf11849ff962b50e013948a8c050d620e2f48ae34 Jul 23 18:30:44.574024 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.573989 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:30:44.574134 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.574073 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:30:44.574134 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.574122 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:30:44.989627 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.989591 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" event={"ID":"d5a05f24-0c0d-4767-bff7-7b7cee275438","Type":"ContainerStarted","Data":"36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2"} Jul 23 18:30:44.989833 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:44.989640 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" event={"ID":"d5a05f24-0c0d-4767-bff7-7b7cee275438","Type":"ContainerStarted","Data":"40ea0b6c158b15776611c10bf11849ff962b50e013948a8c050d620e2f48ae34"} Jul 23 18:30:45.020098 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:45.020039 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" podStartSLOduration=1.020018531 podStartE2EDuration="1.020018531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:30:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:30:45.018104496 +0000 UTC m=+1703.258616177" watchObservedRunningTime="2026-07-23 18:30:45.020018531 +0000 UTC m=+1703.260530211" Jul 23 18:30:45.429859 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:45.429767 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:45.434663 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:45.434639 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:45.993970 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:45.993937 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:30:45.994990 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:30:45.994968 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:31:01.416105 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:01.416068 2580 patch_prober.go:28] interesting pod/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": read tcp 10.134.0.2:60454->10.134.0.22:15021: read: connection reset by peer" start-of-body= Jul 23 18:31:01.416602 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:01.416153 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": read tcp 10.134.0.2:60454->10.134.0.22:15021: read: connection reset by peer" Jul 23 18:31:02.089540 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:02.089507 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerID="36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2" exitCode=0 Jul 23 18:31:02.089723 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:02.089550 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" event={"ID":"d5a05f24-0c0d-4767-bff7-7b7cee275438","Type":"ContainerDied","Data":"36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2"} Jul 23 18:31:02.089912 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:02.089897 2580 scope.go:117] "RemoveContainer" containerID="36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2" Jul 23 18:31:02.090889 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:02.090861 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:02.090959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:02.090930 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:02.090998 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:02.090978 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:03.095235 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:03.095202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" event={"ID":"d5a05f24-0c0d-4767-bff7-7b7cee275438","Type":"ContainerStarted","Data":"83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070"} Jul 23 18:31:03.430441 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:03.430362 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:31:03.430599 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:03.430572 2580 patch_prober.go:28] interesting pod/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 23 18:31:03.430670 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:03.430644 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 23 18:31:04.430819 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:04.430780 2580 patch_prober.go:28] interesting pod/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 23 18:31:04.431282 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:04.430845 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 23 18:31:05.430355 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:05.430288 2580 patch_prober.go:28] interesting pod/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 23 18:31:05.430520 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:05.430371 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 23 18:31:06.430853 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:06.430812 2580 patch_prober.go:28] interesting pod/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body= Jul 23 18:31:06.431243 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:06.430871 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" Jul 23 18:31:07.433478 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:07.433445 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:31:07.433866 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:07.433773 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:31:07.434364 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:07.434340 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:31:27.379596 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:27.379551 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d"] Jul 23 18:31:27.380220 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:27.379784 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" containerID="cri-o://83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070" gracePeriod=30 Jul 23 18:31:28.463226 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.463194 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5"] Jul 23 18:31:28.466597 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.466575 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.469163 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.469129 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0b3404de-gw-openshift-default-dockercfg-r27nf\"" Jul 23 18:31:28.478237 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.478211 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5"] Jul 23 18:31:28.566830 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.566795 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-certs\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567008 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.566847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-credential-socket\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567008 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.566880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed9d74e7-7964-4054-82c3-59705abc09cb-istiod-ca-cert\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567008 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.566914 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-data\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567008 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.566949 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-envoy\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567201 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.567047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-socket\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567201 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.567086 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-token\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567201 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.567153 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-podinfo\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.567347 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.567209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzmq4\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-kube-api-access-rzmq4\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668386 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed9d74e7-7964-4054-82c3-59705abc09cb-istiod-ca-cert\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-data\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-envoy\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668489 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-socket\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668512 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-token\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668551 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-podinfo\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668576 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzmq4\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-kube-api-access-rzmq4\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668905 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-certs\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.668905 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.668661 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-credential-socket\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.669252 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.669131 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-data\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.669252 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.669161 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-socket\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.669252 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.669198 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-credential-socket\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.669252 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.669224 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-certs\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.669476 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.669383 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed9d74e7-7964-4054-82c3-59705abc09cb-istiod-ca-cert\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.670998 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.670982 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-envoy\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.671480 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.671464 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-podinfo\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.679776 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.679746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-token\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.685054 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.685030 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzmq4\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-kube-api-access-rzmq4\") pod \"e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.779066 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.779030 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:28.921107 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.921078 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5"] Jul 23 18:31:28.922918 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:31:28.922899 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded9d74e7_7964_4054_82c3_59705abc09cb.slice/crio-0990abc8ba3e436f4c221cfb868fce5cdb0ec3a28201684ae189ba76758a6a0b WatchSource:0}: Error finding container 0990abc8ba3e436f4c221cfb868fce5cdb0ec3a28201684ae189ba76758a6a0b: Status 404 returned error can't find the container with id 0990abc8ba3e436f4c221cfb868fce5cdb0ec3a28201684ae189ba76758a6a0b Jul 23 18:31:28.924887 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.924858 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:28.924955 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.924918 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:28.924955 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:28.924947 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:29.203115 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:29.203031 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" event={"ID":"ed9d74e7-7964-4054-82c3-59705abc09cb","Type":"ContainerStarted","Data":"f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a"} Jul 23 18:31:29.203115 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:29.203084 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" event={"ID":"ed9d74e7-7964-4054-82c3-59705abc09cb","Type":"ContainerStarted","Data":"0990abc8ba3e436f4c221cfb868fce5cdb0ec3a28201684ae189ba76758a6a0b"} Jul 23 18:31:29.227222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:29.227168 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" podStartSLOduration=1.227151557 podStartE2EDuration="1.227151557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:31:29.225864449 +0000 UTC m=+1747.466376130" watchObservedRunningTime="2026-07-23 18:31:29.227151557 +0000 UTC m=+1747.467663236" Jul 23 18:31:29.780007 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:29.779959 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:29.784915 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:29.784886 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:30.208060 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:30.207976 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:30.209090 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:30.209075 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:32.629648 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.629621 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:31:32.704438 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704324 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-socket\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704438 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704386 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-certs\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704438 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704405 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-envoy\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704438 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704431 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrrfv\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-kube-api-access-xrrfv\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704456 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-credential-socket\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704472 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-token\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704498 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5a05f24-0c0d-4767-bff7-7b7cee275438-istiod-ca-cert\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704533 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-podinfo\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704579 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-data\") pod \"d5a05f24-0c0d-4767-bff7-7b7cee275438\" (UID: \"d5a05f24-0c0d-4767-bff7-7b7cee275438\") " Jul 23 18:31:32.704765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704716 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:31:32.705064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704778 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:31:32.705064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704925 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.705064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704944 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.705064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.704917 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:31:32.705459 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.705192 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5a05f24-0c0d-4767-bff7-7b7cee275438-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:31:32.705730 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.705701 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:31:32.706888 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.706864 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:31:32.706888 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.706875 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-kube-api-access-xrrfv" (OuterVolumeSpecName: "kube-api-access-xrrfv") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "kube-api-access-xrrfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:31:32.707029 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.706931 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:31:32.707029 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.706971 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5a05f24-0c0d-4767-bff7-7b7cee275438" (UID: "d5a05f24-0c0d-4767-bff7-7b7cee275438"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:31:32.805992 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.805950 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5a05f24-0c0d-4767-bff7-7b7cee275438-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.805992 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.805984 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.805992 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.805997 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.806221 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.806008 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.806221 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.806020 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.806221 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.806030 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrrfv\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-kube-api-access-xrrfv\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:32.806221 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:32.806042 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5a05f24-0c0d-4767-bff7-7b7cee275438-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:31:33.227924 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.227893 2580 generic.go:356] "Generic (PLEG): container finished" podID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerID="83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070" exitCode=0 Jul 23 18:31:33.227924 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.227929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" event={"ID":"d5a05f24-0c0d-4767-bff7-7b7cee275438","Type":"ContainerDied","Data":"83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070"} Jul 23 18:31:33.228156 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.227945 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" Jul 23 18:31:33.228156 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.227971 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d" event={"ID":"d5a05f24-0c0d-4767-bff7-7b7cee275438","Type":"ContainerDied","Data":"40ea0b6c158b15776611c10bf11849ff962b50e013948a8c050d620e2f48ae34"} Jul 23 18:31:33.228156 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.227992 2580 scope.go:117] "RemoveContainer" containerID="83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070" Jul 23 18:31:33.237002 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.236985 2580 scope.go:117] "RemoveContainer" containerID="36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2" Jul 23 18:31:33.244932 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.244915 2580 scope.go:117] "RemoveContainer" containerID="83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070" Jul 23 18:31:33.245237 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:31:33.245217 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070\": container with ID starting with 83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070 not found: ID does not exist" containerID="83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070" Jul 23 18:31:33.245272 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.245245 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070"} err="failed to get container status \"83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070\": rpc error: code = NotFound desc = could not find container \"83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070\": container with ID starting with 83589f1d1c5c362ff3f166af2e8168f9b7c9b100d1cf4216ba019935b8f9e070 not found: ID does not exist" Jul 23 18:31:33.245311 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.245276 2580 scope.go:117] "RemoveContainer" containerID="36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2" Jul 23 18:31:33.245530 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:31:33.245513 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2\": container with ID starting with 36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2 not found: ID does not exist" containerID="36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2" Jul 23 18:31:33.245579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.245539 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2"} err="failed to get container status \"36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2\": rpc error: code = NotFound desc = could not find container \"36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2\": container with ID starting with 36c23b4e212bf14e1838b519f7cab6802ac74c218935044bc77f7e425d5675e2 not found: ID does not exist" Jul 23 18:31:33.250159 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.250136 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d"] Jul 23 18:31:33.257228 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:33.257205 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a922dc39-openshift-default-88b8f7d77-z6c2d"] Jul 23 18:31:34.261858 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:34.261819 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" path="/var/lib/kubelet/pods/d5a05f24-0c0d-4767-bff7-7b7cee275438/volumes" Jul 23 18:31:45.621894 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:45.621519 2580 patch_prober.go:28] interesting pod/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": read tcp 10.134.0.2:46254->10.134.0.23:15021: read: connection reset by peer" start-of-body= Jul 23 18:31:45.621894 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:45.621603 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": read tcp 10.134.0.2:46254->10.134.0.23:15021: read: connection reset by peer" Jul 23 18:31:46.286022 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:46.285992 2580 generic.go:356] "Generic (PLEG): container finished" podID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerID="f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a" exitCode=0 Jul 23 18:31:46.286197 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:46.286077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" event={"ID":"ed9d74e7-7964-4054-82c3-59705abc09cb","Type":"ContainerDied","Data":"f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a"} Jul 23 18:31:46.286504 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:46.286490 2580 scope.go:117] "RemoveContainer" containerID="f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a" Jul 23 18:31:46.287489 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:46.287460 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:46.287564 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:46.287546 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:46.287616 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:46.287600 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:31:47.292426 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:47.292393 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" event={"ID":"ed9d74e7-7964-4054-82c3-59705abc09cb","Type":"ContainerStarted","Data":"88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758"} Jul 23 18:31:47.780199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:47.780155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:47.780396 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:47.780377 2580 patch_prober.go:28] interesting pod/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 23 18:31:47.780444 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:47.780423 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 23 18:31:48.779747 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:48.779705 2580 patch_prober.go:28] interesting pod/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 23 18:31:48.780128 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:48.779770 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 23 18:31:49.780427 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:49.780384 2580 patch_prober.go:28] interesting pod/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 23 18:31:49.780838 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:49.780442 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 23 18:31:50.779925 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:50.779886 2580 patch_prober.go:28] interesting pod/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body= Jul 23 18:31:50.780104 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:50.779942 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" Jul 23 18:31:51.783228 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:51.783199 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:51.783708 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:51.783546 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:31:51.784044 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:31:51.784019 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:32:16.164432 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:16.164321 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5"] Jul 23 18:32:16.164934 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:16.164565 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" containerID="cri-o://88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758" gracePeriod=30 Jul 23 18:32:21.421583 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.421559 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:32:21.432100 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.432021 2580 generic.go:356] "Generic (PLEG): container finished" podID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerID="88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758" exitCode=0 Jul 23 18:32:21.432100 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.432066 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" Jul 23 18:32:21.432291 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.432099 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" event={"ID":"ed9d74e7-7964-4054-82c3-59705abc09cb","Type":"ContainerDied","Data":"88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758"} Jul 23 18:32:21.432291 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.432152 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5" event={"ID":"ed9d74e7-7964-4054-82c3-59705abc09cb","Type":"ContainerDied","Data":"0990abc8ba3e436f4c221cfb868fce5cdb0ec3a28201684ae189ba76758a6a0b"} Jul 23 18:32:21.432291 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.432175 2580 scope.go:117] "RemoveContainer" containerID="88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758" Jul 23 18:32:21.440193 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.440173 2580 scope.go:117] "RemoveContainer" containerID="f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a" Jul 23 18:32:21.447868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.447844 2580 scope.go:117] "RemoveContainer" containerID="88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758" Jul 23 18:32:21.448137 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:32:21.448115 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758\": container with ID starting with 88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758 not found: ID does not exist" containerID="88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758" Jul 23 18:32:21.448205 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.448152 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758"} err="failed to get container status \"88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758\": rpc error: code = NotFound desc = could not find container \"88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758\": container with ID starting with 88aa6886a02c61189a65f658067428bfd26b4efdf1e0cd796c89fa54abf21758 not found: ID does not exist" Jul 23 18:32:21.448205 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.448178 2580 scope.go:117] "RemoveContainer" containerID="f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a" Jul 23 18:32:21.448469 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:32:21.448452 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a\": container with ID starting with f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a not found: ID does not exist" containerID="f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a" Jul 23 18:32:21.448529 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.448476 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a"} err="failed to get container status \"f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a\": rpc error: code = NotFound desc = could not find container \"f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a\": container with ID starting with f4b59d9a4a36fc72d276f7786e9fd49286819b1d0b800672fe587fca3297aa9a not found: ID does not exist" Jul 23 18:32:21.533054 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533024 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-envoy\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533087 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-credential-socket\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533126 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-socket\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533162 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzmq4\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-kube-api-access-rzmq4\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533185 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-podinfo\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533212 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-certs\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533235 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed9d74e7-7964-4054-82c3-59705abc09cb-istiod-ca-cert\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533587 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533279 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-data\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533587 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533304 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-token\") pod \"ed9d74e7-7964-4054-82c3-59705abc09cb\" (UID: \"ed9d74e7-7964-4054-82c3-59705abc09cb\") " Jul 23 18:32:21.533587 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533446 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:32:21.533587 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533503 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:32:21.533587 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533521 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:32:21.533851 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533636 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.533851 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533654 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.533851 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533670 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.534005 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.533855 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed9d74e7-7964-4054-82c3-59705abc09cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:21.534528 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.534502 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:32:21.535482 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.535460 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:32:21.535713 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.535693 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-kube-api-access-rzmq4" (OuterVolumeSpecName: "kube-api-access-rzmq4") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "kube-api-access-rzmq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:32:21.535765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.535693 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:32:21.535765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.535737 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed9d74e7-7964-4054-82c3-59705abc09cb" (UID: "ed9d74e7-7964-4054-82c3-59705abc09cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:32:21.634794 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.634755 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rzmq4\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-kube-api-access-rzmq4\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.634794 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.634792 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.634794 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.634803 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed9d74e7-7964-4054-82c3-59705abc09cb-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.635029 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.634811 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.635029 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.634820 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.635029 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.634829 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed9d74e7-7964-4054-82c3-59705abc09cb-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:21.754854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.754818 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5"] Jul 23 18:32:21.759432 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:21.759400 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0b3404de-gw-openshift-default-6c55c9cd95-wlxp5"] Jul 23 18:32:22.263809 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:22.263761 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" path="/var/lib/kubelet/pods/ed9d74e7-7964-4054-82c3-59705abc09cb/volumes" Jul 23 18:32:45.708675 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708637 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf"] Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708920 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708930 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708940 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708945 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708953 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708958 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.708999 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.709009 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" Jul 23 18:32:45.709138 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.709015 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5a05f24-0c0d-4767-bff7-7b7cee275438" containerName="istio-proxy" Jul 23 18:32:45.711785 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.711759 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" Jul 23 18:32:45.714710 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.714690 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\"" Jul 23 18:32:45.724375 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.722979 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf"] Jul 23 18:32:45.838822 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.838776 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1569dbd3-263c-4f18-b093-38cf4779e948-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eba22494-qgvzf\" (UID: \"1569dbd3-263c-4f18-b093-38cf4779e948\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" Jul 23 18:32:45.940149 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.940115 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1569dbd3-263c-4f18-b093-38cf4779e948-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eba22494-qgvzf\" (UID: \"1569dbd3-263c-4f18-b093-38cf4779e948\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" Jul 23 18:32:45.940755 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:45.940734 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1569dbd3-263c-4f18-b093-38cf4779e948-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eba22494-qgvzf\" (UID: \"1569dbd3-263c-4f18-b093-38cf4779e948\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" Jul 23 18:32:46.023890 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:46.023853 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" Jul 23 18:32:46.157751 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:46.157608 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf"] Jul 23 18:32:46.159933 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:32:46.159904 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1569dbd3_263c_4f18_b093_38cf4779e948.slice/crio-938ab4174f8e8fb72d76b0dab14d237d30001972939de3a6842dc8caf3fa07a9 WatchSource:0}: Error finding container 938ab4174f8e8fb72d76b0dab14d237d30001972939de3a6842dc8caf3fa07a9: Status 404 returned error can't find the container with id 938ab4174f8e8fb72d76b0dab14d237d30001972939de3a6842dc8caf3fa07a9 Jul 23 18:32:46.161764 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:46.161750 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:32:46.532082 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:46.532045 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" event={"ID":"1569dbd3-263c-4f18-b093-38cf4779e948","Type":"ContainerStarted","Data":"938ab4174f8e8fb72d76b0dab14d237d30001972939de3a6842dc8caf3fa07a9"} Jul 23 18:32:49.548269 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:49.548236 2580 generic.go:356] "Generic (PLEG): container finished" podID="1569dbd3-263c-4f18-b093-38cf4779e948" containerID="5c11f6c4a7c969dd925b9ef51495b26e3a31df36e9872974e8fd0e8741e6f6dc" exitCode=0 Jul 23 18:32:49.548685 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:49.548325 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" event={"ID":"1569dbd3-263c-4f18-b093-38cf4779e948","Type":"ContainerDied","Data":"5c11f6c4a7c969dd925b9ef51495b26e3a31df36e9872974e8fd0e8741e6f6dc"} Jul 23 18:32:50.680915 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:50.680892 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" Jul 23 18:32:50.785955 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:50.785916 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1569dbd3-263c-4f18-b093-38cf4779e948-maas-api-service-ca\") pod \"1569dbd3-263c-4f18-b093-38cf4779e948\" (UID: \"1569dbd3-263c-4f18-b093-38cf4779e948\") " Jul 23 18:32:50.786272 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:50.786246 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1569dbd3-263c-4f18-b093-38cf4779e948-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1569dbd3-263c-4f18-b093-38cf4779e948" (UID: "1569dbd3-263c-4f18-b093-38cf4779e948"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:32:50.887151 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:50.887065 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1569dbd3-263c-4f18-b093-38cf4779e948-maas-api-service-ca\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:32:51.557949 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:51.557922 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" Jul 23 18:32:51.558120 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:51.557918 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf" event={"ID":"1569dbd3-263c-4f18-b093-38cf4779e948","Type":"ContainerDied","Data":"938ab4174f8e8fb72d76b0dab14d237d30001972939de3a6842dc8caf3fa07a9"} Jul 23 18:32:51.558120 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:32:51.558046 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="938ab4174f8e8fb72d76b0dab14d237d30001972939de3a6842dc8caf3fa07a9" Jul 23 18:33:00.793693 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:00.793656 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf"] Jul 23 18:33:00.796937 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:00.796905 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eba22494-qgvzf"] Jul 23 18:33:02.262272 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.262237 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1569dbd3-263c-4f18-b093-38cf4779e948" path="/var/lib/kubelet/pods/1569dbd3-263c-4f18-b093-38cf4779e948/volumes" Jul 23 18:33:02.973001 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.972964 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n"] Jul 23 18:33:02.973397 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.973382 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" Jul 23 18:33:02.973452 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.973400 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" Jul 23 18:33:02.973452 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.973415 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1569dbd3-263c-4f18-b093-38cf4779e948" containerName="revoke-keys" Jul 23 18:33:02.973452 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.973423 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1569dbd3-263c-4f18-b093-38cf4779e948" containerName="revoke-keys" Jul 23 18:33:02.973555 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.973512 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1569dbd3-263c-4f18-b093-38cf4779e948" containerName="revoke-keys" Jul 23 18:33:02.973555 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.973524 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed9d74e7-7964-4054-82c3-59705abc09cb" containerName="istio-proxy" Jul 23 18:33:02.976747 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.976728 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.980713 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.980689 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1b2c435a-openshift-default-dockercfg-55794\"" Jul 23 18:33:02.989995 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.989964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-token\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990112 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istiod-ca-cert\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990112 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990037 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-certs\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990112 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-podinfo\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-credential-socket\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990166 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-envoy\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990197 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f4qs\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-kube-api-access-5f4qs\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990229 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-socket\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.990469 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.990263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-data\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:02.992635 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:02.992611 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n"] Jul 23 18:33:03.090617 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090585 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-credential-socket\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.090826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090630 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-envoy\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.090826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090653 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f4qs\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-kube-api-access-5f4qs\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.090826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090682 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-socket\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.090826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090712 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-data\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.090826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090766 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-token\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.090826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090787 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istiod-ca-cert\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.090826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090810 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-certs\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.091199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.090838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-podinfo\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.091199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.091143 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-credential-socket\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.091199 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.091178 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-data\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.091515 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.091468 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-certs\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.091623 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.091534 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-socket\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.091849 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.091824 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istiod-ca-cert\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.093954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.093936 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-envoy\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.094185 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.094165 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-podinfo\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.100843 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.100819 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f4qs\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-kube-api-access-5f4qs\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.100954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.100919 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-token\") pod \"e2e-derive-1b2c435a-openshift-default-757566677f-f525n\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.286808 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.286768 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:03.434354 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.433682 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n"] Jul 23 18:33:03.439129 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.439083 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:33:03.439220 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.439165 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:33:03.439220 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.439193 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:33:03.609876 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.609782 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" event={"ID":"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902","Type":"ContainerStarted","Data":"af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2"} Jul 23 18:33:03.609876 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.609848 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" event={"ID":"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902","Type":"ContainerStarted","Data":"fc6c6513c0ed94a98a9a3ec49315ca6ea06f6b3feb59bcb3b714aa1010f17204"} Jul 23 18:33:03.636243 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:03.636190 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" podStartSLOduration=1.636176066 podStartE2EDuration="1.636176066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:33:03.635521061 +0000 UTC m=+1841.876032744" watchObservedRunningTime="2026-07-23 18:33:03.636176066 +0000 UTC m=+1841.876687746" Jul 23 18:33:04.287979 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:04.287940 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:04.292620 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:04.292595 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:04.614373 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:04.614273 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:04.615285 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:04.615264 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:19.616222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.616125 2580 patch_prober.go:28] interesting pod/e2e-derive-1b2c435a-openshift-default-757566677f-f525n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 23 18:33:19.616222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.616193 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 23 18:33:19.682493 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.682459 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerID="af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2" exitCode=0 Jul 23 18:33:19.682645 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.682534 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" event={"ID":"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902","Type":"ContainerDied","Data":"af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2"} Jul 23 18:33:19.682920 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.682904 2580 scope.go:117] "RemoveContainer" containerID="af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2" Jul 23 18:33:19.683992 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.683962 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:33:19.684076 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.684029 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:33:19.684076 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:19.684060 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:33:20.688584 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:20.688553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" event={"ID":"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902","Type":"ContainerStarted","Data":"ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da"} Jul 23 18:33:21.287699 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:21.287650 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:21.287901 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:21.287876 2580 patch_prober.go:28] interesting pod/e2e-derive-1b2c435a-openshift-default-757566677f-f525n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 23 18:33:21.287946 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:21.287925 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 23 18:33:22.288055 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:22.288011 2580 patch_prober.go:28] interesting pod/e2e-derive-1b2c435a-openshift-default-757566677f-f525n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 23 18:33:22.288484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:22.288064 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 23 18:33:23.287606 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:23.287568 2580 patch_prober.go:28] interesting pod/e2e-derive-1b2c435a-openshift-default-757566677f-f525n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 23 18:33:23.287808 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:23.287628 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 23 18:33:24.288121 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:24.288083 2580 patch_prober.go:28] interesting pod/e2e-derive-1b2c435a-openshift-default-757566677f-f525n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body= Jul 23 18:33:24.288538 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:24.288139 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" Jul 23 18:33:25.291691 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:25.291657 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:25.292091 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:25.292045 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:25.292698 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:25.292680 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:29.942898 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:29.942859 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq"] Jul 23 18:33:29.946025 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:29.946007 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" Jul 23 18:33:29.948552 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:29.948525 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\"" Jul 23 18:33:29.953899 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:29.953874 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq"] Jul 23 18:33:30.032319 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.032279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29005f7-e312-4a59-846d-aec78258d577-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq\" (UID: \"e29005f7-e312-4a59-846d-aec78258d577\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" Jul 23 18:33:30.132956 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.132918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29005f7-e312-4a59-846d-aec78258d577-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq\" (UID: \"e29005f7-e312-4a59-846d-aec78258d577\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" Jul 23 18:33:30.133566 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.133545 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29005f7-e312-4a59-846d-aec78258d577-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq\" (UID: \"e29005f7-e312-4a59-846d-aec78258d577\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" Jul 23 18:33:30.256619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.256587 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" Jul 23 18:33:30.393741 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.393719 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq"] Jul 23 18:33:30.396033 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:33:30.396008 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29005f7_e312_4a59_846d_aec78258d577.slice/crio-dd9d9ff6278caf915380bc3684139ff0fd03efe5424f150c4816f22750519e12 WatchSource:0}: Error finding container dd9d9ff6278caf915380bc3684139ff0fd03efe5424f150c4816f22750519e12: Status 404 returned error can't find the container with id dd9d9ff6278caf915380bc3684139ff0fd03efe5424f150c4816f22750519e12 Jul 23 18:33:30.737397 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.737357 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" event={"ID":"e29005f7-e312-4a59-846d-aec78258d577","Type":"ContainerStarted","Data":"5d6db33615ac0e17020c3f8777070e7f63eda2a2d588151feabe1d028ccc1748"} Jul 23 18:33:30.737567 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.737419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" event={"ID":"e29005f7-e312-4a59-846d-aec78258d577","Type":"ContainerStarted","Data":"dd9d9ff6278caf915380bc3684139ff0fd03efe5424f150c4816f22750519e12"} Jul 23 18:33:30.754888 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:30.754831 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" podStartSLOduration=1.754815725 podStartE2EDuration="1.754815725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:33:30.753210818 +0000 UTC m=+1868.993722499" watchObservedRunningTime="2026-07-23 18:33:30.754815725 +0000 UTC m=+1868.995327404" Jul 23 18:33:31.743003 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:31.742968 2580 generic.go:356] "Generic (PLEG): container finished" podID="e29005f7-e312-4a59-846d-aec78258d577" containerID="5d6db33615ac0e17020c3f8777070e7f63eda2a2d588151feabe1d028ccc1748" exitCode=0 Jul 23 18:33:31.743425 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:31.743022 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" event={"ID":"e29005f7-e312-4a59-846d-aec78258d577","Type":"ContainerDied","Data":"5d6db33615ac0e17020c3f8777070e7f63eda2a2d588151feabe1d028ccc1748"} Jul 23 18:33:32.881011 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:32.880984 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" Jul 23 18:33:32.955585 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:32.955541 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29005f7-e312-4a59-846d-aec78258d577-maas-api-service-ca\") pod \"e29005f7-e312-4a59-846d-aec78258d577\" (UID: \"e29005f7-e312-4a59-846d-aec78258d577\") " Jul 23 18:33:32.955943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:32.955912 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e29005f7-e312-4a59-846d-aec78258d577-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e29005f7-e312-4a59-846d-aec78258d577" (UID: "e29005f7-e312-4a59-846d-aec78258d577"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:33:33.056785 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:33.056699 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29005f7-e312-4a59-846d-aec78258d577-maas-api-service-ca\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:33.752928 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:33.752890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" event={"ID":"e29005f7-e312-4a59-846d-aec78258d577","Type":"ContainerDied","Data":"dd9d9ff6278caf915380bc3684139ff0fd03efe5424f150c4816f22750519e12"} Jul 23 18:33:33.752928 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:33.752925 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq" Jul 23 18:33:33.752928 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:33.752938 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd9d9ff6278caf915380bc3684139ff0fd03efe5424f150c4816f22750519e12" Jul 23 18:33:45.027977 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:45.027893 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq"] Jul 23 18:33:45.030311 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:45.030284 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-1b2c435a-mqwrq"] Jul 23 18:33:45.172398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:45.172350 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n"] Jul 23 18:33:45.172632 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:45.172595 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" containerID="cri-o://ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da" gracePeriod=30 Jul 23 18:33:46.261997 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:46.261965 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e29005f7-e312-4a59-846d-aec78258d577" path="/var/lib/kubelet/pods/e29005f7-e312-4a59-846d-aec78258d577/volumes" Jul 23 18:33:50.433934 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.433879 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:50.507676 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507646 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-podinfo\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.507868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507684 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-data\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.507868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507705 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-socket\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.507868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507732 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-certs\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.507868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507794 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f4qs\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-kube-api-access-5f4qs\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.507868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507837 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-token\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.507868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507860 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istiod-ca-cert\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.508162 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507885 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-envoy\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.508162 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.507922 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-credential-socket\") pod \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\" (UID: \"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902\") " Jul 23 18:33:50.508162 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.508026 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:33:50.508314 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.508192 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.508314 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.508189 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:33:50.508465 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.508375 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:33:50.508632 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.508598 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:33:50.508916 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.508853 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-data" (OuterVolumeSpecName: "istio-data") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:33:50.510155 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.510129 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:33:50.510258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.510167 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:33:50.510258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.510238 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-token" (OuterVolumeSpecName: "istio-token") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:33:50.510477 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.510454 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-kube-api-access-5f4qs" (OuterVolumeSpecName: "kube-api-access-5f4qs") pod "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" (UID: "ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902"). InnerVolumeSpecName "kube-api-access-5f4qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:33:50.609499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609458 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.609499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609491 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.609499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609503 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.609732 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609514 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f4qs\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-kube-api-access-5f4qs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.609732 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609527 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.609732 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609539 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.609732 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609549 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.609732 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.609559 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:33:50.827503 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.827465 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerID="ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da" exitCode=0 Jul 23 18:33:50.827699 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.827519 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" Jul 23 18:33:50.827699 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.827555 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" event={"ID":"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902","Type":"ContainerDied","Data":"ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da"} Jul 23 18:33:50.827699 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.827627 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n" event={"ID":"ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902","Type":"ContainerDied","Data":"fc6c6513c0ed94a98a9a3ec49315ca6ea06f6b3feb59bcb3b714aa1010f17204"} Jul 23 18:33:50.827699 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.827658 2580 scope.go:117] "RemoveContainer" containerID="ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da" Jul 23 18:33:50.838735 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.838710 2580 scope.go:117] "RemoveContainer" containerID="af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2" Jul 23 18:33:50.846751 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.846733 2580 scope.go:117] "RemoveContainer" containerID="ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da" Jul 23 18:33:50.847009 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:33:50.846988 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da\": container with ID starting with ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da not found: ID does not exist" containerID="ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da" Jul 23 18:33:50.847066 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.847017 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da"} err="failed to get container status \"ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da\": rpc error: code = NotFound desc = could not find container \"ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da\": container with ID starting with ddf9c21d3a1ce721928c36c5e540ceef007e5c4b2fd994a12878aa66ca2345da not found: ID does not exist" Jul 23 18:33:50.847066 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.847037 2580 scope.go:117] "RemoveContainer" containerID="af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2" Jul 23 18:33:50.847256 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:33:50.847237 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2\": container with ID starting with af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2 not found: ID does not exist" containerID="af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2" Jul 23 18:33:50.847309 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.847266 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2"} err="failed to get container status \"af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2\": rpc error: code = NotFound desc = could not find container \"af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2\": container with ID starting with af0776a3ad0d0b4ca4f282a3d95109165208c26050931b97114ed785c70958c2 not found: ID does not exist" Jul 23 18:33:50.852949 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.852928 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n"] Jul 23 18:33:50.860160 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:50.860138 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1b2c435a-openshift-default-757566677f-f525n"] Jul 23 18:33:52.264867 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:33:52.264827 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" path="/var/lib/kubelet/pods/ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902/volumes" Jul 23 18:35:27.794803 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.794771 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl"] Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795073 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795083 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795096 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e29005f7-e312-4a59-846d-aec78258d577" containerName="revoke-keys" Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795101 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e29005f7-e312-4a59-846d-aec78258d577" containerName="revoke-keys" Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795109 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795115 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795166 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" Jul 23 18:35:27.795254 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.795173 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e29005f7-e312-4a59-846d-aec78258d577" containerName="revoke-keys" Jul 23 18:35:27.798028 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.798011 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.800939 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.800918 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3c233914-openshift-default-dockercfg-cxdfd\"" Jul 23 18:35:27.822906 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.822877 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl"] Jul 23 18:35:27.918231 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2da06f8-8b5f-4880-913e-4c98e100cce0-istiod-ca-cert\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918231 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918239 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-token\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918486 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918281 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-podinfo\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918486 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918357 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-socket\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918486 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918407 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-envoy\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918486 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918430 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-certs\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918486 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-data\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918703 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-credential-socket\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:27.918703 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:27.918532 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwxm5\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-kube-api-access-hwxm5\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-credential-socket\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019189 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwxm5\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-kube-api-access-hwxm5\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019494 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019221 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2da06f8-8b5f-4880-913e-4c98e100cce0-istiod-ca-cert\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019494 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-token\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019494 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-podinfo\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019494 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019467 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-socket\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019698 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019533 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-envoy\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019698 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019562 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-certs\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019698 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019603 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-data\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019698 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019628 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-credential-socket\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.019908 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.019871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-socket\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.020070 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.020032 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-data\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.020070 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.020060 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-certs\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.020224 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.020205 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2da06f8-8b5f-4880-913e-4c98e100cce0-istiod-ca-cert\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.021883 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.021853 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-envoy\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.022022 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.022001 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-podinfo\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.029675 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.029654 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-token\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.030814 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.030789 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwxm5\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-kube-api-access-hwxm5\") pod \"e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.107800 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.107709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:28.249293 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.249271 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl"] Jul 23 18:35:28.251413 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:35:28.251387 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2da06f8_8b5f_4880_913e_4c98e100cce0.slice/crio-63b1841519d4569b0eaffb17203d721532e722c183ae9ae580b37f220fd69e04 WatchSource:0}: Error finding container 63b1841519d4569b0eaffb17203d721532e722c183ae9ae580b37f220fd69e04: Status 404 returned error can't find the container with id 63b1841519d4569b0eaffb17203d721532e722c183ae9ae580b37f220fd69e04 Jul 23 18:35:28.253365 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.253311 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:35:28.253451 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.253396 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:35:28.253451 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:28.253445 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:35:29.249647 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:29.249612 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" event={"ID":"e2da06f8-8b5f-4880-913e-4c98e100cce0","Type":"ContainerStarted","Data":"ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99"} Jul 23 18:35:29.250055 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:29.249671 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" event={"ID":"e2da06f8-8b5f-4880-913e-4c98e100cce0","Type":"ContainerStarted","Data":"63b1841519d4569b0eaffb17203d721532e722c183ae9ae580b37f220fd69e04"} Jul 23 18:35:29.397613 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:29.397560 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" podStartSLOduration=2.397544761 podStartE2EDuration="2.397544761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:35:29.387269708 +0000 UTC m=+1987.627781388" watchObservedRunningTime="2026-07-23 18:35:29.397544761 +0000 UTC m=+1987.638056440" Jul 23 18:35:30.108389 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:30.108321 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:30.113190 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:30.113165 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:30.253489 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:30.253457 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:30.254280 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:30.254260 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:42.306721 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:42.306689 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerID="ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99" exitCode=0 Jul 23 18:35:42.307135 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:42.306767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" event={"ID":"e2da06f8-8b5f-4880-913e-4c98e100cce0","Type":"ContainerDied","Data":"ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99"} Jul 23 18:35:42.307248 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:42.307230 2580 scope.go:117] "RemoveContainer" containerID="ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99" Jul 23 18:35:42.308309 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:42.308281 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:35:42.308394 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:42.308371 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:35:42.308430 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:42.308405 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:35:43.313200 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:43.313156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" event={"ID":"e2da06f8-8b5f-4880-913e-4c98e100cce0","Type":"ContainerStarted","Data":"17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3"} Jul 23 18:35:44.108495 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:44.108456 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:44.109687 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:44.109657 2580 patch_prober.go:28] interesting pod/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 23 18:35:44.109799 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:44.109727 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 23 18:35:45.108738 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:45.108702 2580 patch_prober.go:28] interesting pod/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 23 18:35:45.109136 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:45.108770 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 23 18:35:45.254322 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:45.254266 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:46.108311 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:46.108273 2580 patch_prober.go:28] interesting pod/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 23 18:35:46.108515 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:46.108356 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 23 18:35:47.108176 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:47.108127 2580 patch_prober.go:28] interesting pod/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body= Jul 23 18:35:47.108615 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:47.108213 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" Jul 23 18:35:48.112281 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:48.112244 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:35:48.113251 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:35:48.113229 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:36:06.381484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:06.381447 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl"] Jul 23 18:36:06.382082 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:06.381668 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" containerID="cri-o://17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3" gracePeriod=30 Jul 23 18:36:11.630689 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.630660 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:36:11.797257 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797214 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-token\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797282 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwxm5\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-kube-api-access-hwxm5\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797311 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-socket\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797364 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-podinfo\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797406 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-credential-socket\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797431 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-data\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797484 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797461 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-certs\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797770 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797505 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-envoy\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797770 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797545 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2da06f8-8b5f-4880-913e-4c98e100cce0-istiod-ca-cert\") pod \"e2da06f8-8b5f-4880-913e-4c98e100cce0\" (UID: \"e2da06f8-8b5f-4880-913e-4c98e100cce0\") " Jul 23 18:36:11.797770 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797661 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:36:11.797770 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797671 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:36:11.797972 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797799 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.797972 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797817 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.797972 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797921 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:36:11.797972 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.797933 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2da06f8-8b5f-4880-913e-4c98e100cce0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:36:11.798523 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.798497 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:36:11.799730 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.799702 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:36:11.799730 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.799719 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:36:11.800159 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.800140 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-kube-api-access-hwxm5" (OuterVolumeSpecName: "kube-api-access-hwxm5") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "kube-api-access-hwxm5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:36:11.800223 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.800175 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2da06f8-8b5f-4880-913e-4c98e100cce0" (UID: "e2da06f8-8b5f-4880-913e-4c98e100cce0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:36:11.898554 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.898513 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.898554 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.898547 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.898554 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.898557 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.898554 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.898565 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2da06f8-8b5f-4880-913e-4c98e100cce0-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.898821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.898573 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.898821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.898583 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwxm5\" (UniqueName: \"kubernetes.io/projected/e2da06f8-8b5f-4880-913e-4c98e100cce0-kube-api-access-hwxm5\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:11.898821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:11.898592 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2da06f8-8b5f-4880-913e-4c98e100cce0-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:36:12.436562 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.436530 2580 generic.go:356] "Generic (PLEG): container finished" podID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerID="17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3" exitCode=0 Jul 23 18:36:12.436726 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.436578 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" Jul 23 18:36:12.436726 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.436608 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" event={"ID":"e2da06f8-8b5f-4880-913e-4c98e100cce0","Type":"ContainerDied","Data":"17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3"} Jul 23 18:36:12.436726 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.436661 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl" event={"ID":"e2da06f8-8b5f-4880-913e-4c98e100cce0","Type":"ContainerDied","Data":"63b1841519d4569b0eaffb17203d721532e722c183ae9ae580b37f220fd69e04"} Jul 23 18:36:12.436726 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.436684 2580 scope.go:117] "RemoveContainer" containerID="17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3" Jul 23 18:36:12.445236 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.445217 2580 scope.go:117] "RemoveContainer" containerID="ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99" Jul 23 18:36:12.452702 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.452686 2580 scope.go:117] "RemoveContainer" containerID="17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3" Jul 23 18:36:12.452941 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:36:12.452918 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3\": container with ID starting with 17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3 not found: ID does not exist" containerID="17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3" Jul 23 18:36:12.452996 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.452950 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3"} err="failed to get container status \"17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3\": rpc error: code = NotFound desc = could not find container \"17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3\": container with ID starting with 17c563a20d8491bb58ae89a9ffa9d94dbec3368e899af6c60b45f63ded8e85d3 not found: ID does not exist" Jul 23 18:36:12.452996 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.452966 2580 scope.go:117] "RemoveContainer" containerID="ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99" Jul 23 18:36:12.453190 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:36:12.453175 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99\": container with ID starting with ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99 not found: ID does not exist" containerID="ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99" Jul 23 18:36:12.453224 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.453193 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99"} err="failed to get container status \"ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99\": rpc error: code = NotFound desc = could not find container \"ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99\": container with ID starting with ea8465aed6dd4f69ea5a09be747ad14beab681bddd49e1e1d200e2b8570d3c99 not found: ID does not exist" Jul 23 18:36:12.470228 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.470204 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl"] Jul 23 18:36:12.473803 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:12.473782 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3c233914-openshift-default-64f65d9bd7-p4kkl"] Jul 23 18:36:14.262525 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:14.262495 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" path="/var/lib/kubelet/pods/e2da06f8-8b5f-4880-913e-4c98e100cce0/volumes" Jul 23 18:36:30.995604 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.995570 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp"] Jul 23 18:36:30.996085 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.995986 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" Jul 23 18:36:30.996085 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.996006 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" Jul 23 18:36:30.996085 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.996027 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" Jul 23 18:36:30.996085 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.996035 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" Jul 23 18:36:30.996281 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.996121 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" Jul 23 18:36:30.996281 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.996136 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba77ac4a-cfa1-4aaa-9c01-d47d6e51c902" containerName="istio-proxy" Jul 23 18:36:30.996281 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.996145 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2da06f8-8b5f-4880-913e-4c98e100cce0" containerName="istio-proxy" Jul 23 18:36:30.999071 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:30.999049 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.003688 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.003665 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a06c87e8-openshift-default-dockercfg-kd5s6\"" Jul 23 18:36:31.017267 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.017238 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp"] Jul 23 18:36:31.154277 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154243 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-data\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154277 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-credential-socket\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154311 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82dv9\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-kube-api-access-82dv9\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-envoy\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154458 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-token\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154493 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-socket\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154541 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-certs\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154561 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-podinfo\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.154722 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.154611 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istiod-ca-cert\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.255926 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-socket\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.255975 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-certs\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.255993 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-podinfo\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256026 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istiod-ca-cert\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256052 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-data\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-credential-socket\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256099 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82dv9\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-kube-api-access-82dv9\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256132 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-envoy\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256153 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-token\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256414 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-socket\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256681 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256656 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-credential-socket\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256735 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256698 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-data\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256790 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256746 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-certs\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.256860 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.256830 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istiod-ca-cert\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.258799 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.258777 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-envoy\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.259046 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.259027 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-podinfo\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.279092 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.279060 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-token\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.279633 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.279615 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82dv9\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-kube-api-access-82dv9\") pod \"e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.309480 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.309448 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:31.473709 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.473650 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp"] Jul 23 18:36:31.476251 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:36:31.476222 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3020cd16_36b3_40cb_9d6d_8d9bea247ebc.slice/crio-9f20530b812315d23c110006cfff938fc387e5b8c4c8ee77af5a61ab8679774f WatchSource:0}: Error finding container 9f20530b812315d23c110006cfff938fc387e5b8c4c8ee77af5a61ab8679774f: Status 404 returned error can't find the container with id 9f20530b812315d23c110006cfff938fc387e5b8c4c8ee77af5a61ab8679774f Jul 23 18:36:31.478408 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.478377 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:31.478478 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.478444 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:31.478478 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.478474 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:31.518522 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:31.518488 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" event={"ID":"3020cd16-36b3-40cb-9d6d-8d9bea247ebc","Type":"ContainerStarted","Data":"9f20530b812315d23c110006cfff938fc387e5b8c4c8ee77af5a61ab8679774f"} Jul 23 18:36:32.525943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:32.525906 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" event={"ID":"3020cd16-36b3-40cb-9d6d-8d9bea247ebc","Type":"ContainerStarted","Data":"4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c"} Jul 23 18:36:32.552558 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:32.552502 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" podStartSLOduration=2.552483374 podStartE2EDuration="2.552483374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:36:32.550103594 +0000 UTC m=+2050.790615273" watchObservedRunningTime="2026-07-23 18:36:32.552483374 +0000 UTC m=+2050.792995133" Jul 23 18:36:33.309836 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:33.309801 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:33.314398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:33.314375 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:33.530395 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:33.530358 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:33.531288 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:33.531264 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:48.532443 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.532358 2580 patch_prober.go:28] interesting pod/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 23 18:36:48.532831 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.532432 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 23 18:36:48.595572 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.595478 2580 generic.go:356] "Generic (PLEG): container finished" podID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerID="4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c" exitCode=0 Jul 23 18:36:48.595572 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.595553 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" event={"ID":"3020cd16-36b3-40cb-9d6d-8d9bea247ebc","Type":"ContainerDied","Data":"4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c"} Jul 23 18:36:48.595974 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.595960 2580 scope.go:117] "RemoveContainer" containerID="4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c" Jul 23 18:36:48.597061 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.597031 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:48.597134 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.597116 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:48.597181 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:48.597167 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:36:49.601857 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:49.601824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" event={"ID":"3020cd16-36b3-40cb-9d6d-8d9bea247ebc","Type":"ContainerStarted","Data":"3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100"} Jul 23 18:36:50.309810 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:50.309778 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:50.309981 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:50.309931 2580 patch_prober.go:28] interesting pod/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 23 18:36:50.310023 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:50.309972 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 23 18:36:51.310658 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:51.310619 2580 patch_prober.go:28] interesting pod/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 23 18:36:51.311082 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:51.310678 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 23 18:36:52.309972 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:52.309889 2580 patch_prober.go:28] interesting pod/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 23 18:36:52.310181 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:52.310014 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 23 18:36:53.310910 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:53.310872 2580 patch_prober.go:28] interesting pod/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jul 23 18:36:53.311286 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:53.310943 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jul 23 18:36:54.314147 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:54.314118 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:54.314536 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:54.314421 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:36:54.315050 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:36:54.315036 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:37:12.738720 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:12.738686 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m"] Jul 23 18:37:12.743360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:12.743001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" Jul 23 18:37:12.747074 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:12.747053 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hsht7\"" Jul 23 18:37:12.750360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:12.750318 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m"] Jul 23 18:37:12.822879 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:12.822845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1820519-fe13-496e-81b2-3817c6215d80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m\" (UID: \"e1820519-fe13-496e-81b2-3817c6215d80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" Jul 23 18:37:12.924314 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:12.924270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1820519-fe13-496e-81b2-3817c6215d80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m\" (UID: \"e1820519-fe13-496e-81b2-3817c6215d80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" Jul 23 18:37:12.924949 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:12.924928 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1820519-fe13-496e-81b2-3817c6215d80-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m\" (UID: \"e1820519-fe13-496e-81b2-3817c6215d80\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" Jul 23 18:37:13.056561 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:13.056474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" Jul 23 18:37:13.191590 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:13.191485 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m"] Jul 23 18:37:13.194480 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:37:13.194454 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1820519_fe13_496e_81b2_3817c6215d80.slice/crio-6694806a6737f1b423ec3acacccb23dc7d845a8a1a3814b6db33497cae48bfe7 WatchSource:0}: Error finding container 6694806a6737f1b423ec3acacccb23dc7d845a8a1a3814b6db33497cae48bfe7: Status 404 returned error can't find the container with id 6694806a6737f1b423ec3acacccb23dc7d845a8a1a3814b6db33497cae48bfe7 Jul 23 18:37:13.703465 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:13.703376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" event={"ID":"e1820519-fe13-496e-81b2-3817c6215d80","Type":"ContainerStarted","Data":"4cc1e55a4f19cf9aa7c4185756c05bc0bbda731a8761604b3fd1541754b7761b"} Jul 23 18:37:13.703465 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:13.703438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" event={"ID":"e1820519-fe13-496e-81b2-3817c6215d80","Type":"ContainerStarted","Data":"6694806a6737f1b423ec3acacccb23dc7d845a8a1a3814b6db33497cae48bfe7"} Jul 23 18:37:13.721501 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:13.721442 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" podStartSLOduration=1.7214272959999999 podStartE2EDuration="1.721427296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:37:13.720167171 +0000 UTC m=+2091.960678851" watchObservedRunningTime="2026-07-23 18:37:13.721427296 +0000 UTC m=+2091.961938976" Jul 23 18:37:14.708866 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:14.708833 2580 generic.go:356] "Generic (PLEG): container finished" podID="e1820519-fe13-496e-81b2-3817c6215d80" containerID="4cc1e55a4f19cf9aa7c4185756c05bc0bbda731a8761604b3fd1541754b7761b" exitCode=0 Jul 23 18:37:14.709211 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:14.708911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" event={"ID":"e1820519-fe13-496e-81b2-3817c6215d80","Type":"ContainerDied","Data":"4cc1e55a4f19cf9aa7c4185756c05bc0bbda731a8761604b3fd1541754b7761b"} Jul 23 18:37:15.842671 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:15.842645 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" Jul 23 18:37:15.952517 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:15.952478 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1820519-fe13-496e-81b2-3817c6215d80-maas-api-service-ca\") pod \"e1820519-fe13-496e-81b2-3817c6215d80\" (UID: \"e1820519-fe13-496e-81b2-3817c6215d80\") " Jul 23 18:37:15.952860 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:15.952835 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1820519-fe13-496e-81b2-3817c6215d80-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e1820519-fe13-496e-81b2-3817c6215d80" (UID: "e1820519-fe13-496e-81b2-3817c6215d80"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:37:16.053970 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:16.053932 2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1820519-fe13-496e-81b2-3817c6215d80-maas-api-service-ca\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:37:16.718776 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:16.718742 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" Jul 23 18:37:16.718776 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:16.718771 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m" event={"ID":"e1820519-fe13-496e-81b2-3817c6215d80","Type":"ContainerDied","Data":"6694806a6737f1b423ec3acacccb23dc7d845a8a1a3814b6db33497cae48bfe7"} Jul 23 18:37:16.719064 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:16.718820 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6694806a6737f1b423ec3acacccb23dc7d845a8a1a3814b6db33497cae48bfe7" Jul 23 18:37:32.829001 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:32.828962 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m"] Jul 23 18:37:32.832163 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:32.832132 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a06c87e8-bfj6m"] Jul 23 18:37:34.262407 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:37:34.262377 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1820519-fe13-496e-81b2-3817c6215d80" path="/var/lib/kubelet/pods/e1820519-fe13-496e-81b2-3817c6215d80/volumes" Jul 23 18:38:27.626013 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:27.625982 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp"] Jul 23 18:38:27.626546 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:27.626168 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" containerID="cri-o://3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100" gracePeriod=30 Jul 23 18:38:32.878598 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.878560 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:38:32.919954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.919875 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-data\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.919954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.919909 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istiod-ca-cert\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.919954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.919932 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-credential-socket\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.920212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.919964 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82dv9\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-kube-api-access-82dv9\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.920212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.919992 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-socket\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.920212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920050 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-envoy\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.920212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920083 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-podinfo\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.920212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920106 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-token\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.920212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920145 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-certs\") pod \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\" (UID: \"3020cd16-36b3-40cb-9d6d-8d9bea247ebc\") " Jul 23 18:38:32.920535 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920257 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:32.920535 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920500 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:32.920535 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920509 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:32.920691 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920582 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:32.920691 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920657 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:38:32.920786 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.920744 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-data" (OuterVolumeSpecName: "istio-data") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:32.922521 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.922496 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-token" (OuterVolumeSpecName: "istio-token") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:38:32.922625 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.922534 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-kube-api-access-82dv9" (OuterVolumeSpecName: "kube-api-access-82dv9") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "kube-api-access-82dv9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:38:32.922625 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.922561 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:38:32.922768 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:32.922748 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3020cd16-36b3-40cb-9d6d-8d9bea247ebc" (UID: "3020cd16-36b3-40cb-9d6d-8d9bea247ebc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:38:33.021757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021715 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82dv9\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-kube-api-access-82dv9\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.021757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021749 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.021757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021760 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.021757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021768 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.022027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021775 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.022027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021783 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.022027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021791 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.022027 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.021798 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3020cd16-36b3-40cb-9d6d-8d9bea247ebc-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:38:33.040299 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.040263 2580 generic.go:356] "Generic (PLEG): container finished" podID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerID="3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100" exitCode=0 Jul 23 18:38:33.040556 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.040318 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" Jul 23 18:38:33.040556 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.040375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" event={"ID":"3020cd16-36b3-40cb-9d6d-8d9bea247ebc","Type":"ContainerDied","Data":"3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100"} Jul 23 18:38:33.040556 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.040468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp" event={"ID":"3020cd16-36b3-40cb-9d6d-8d9bea247ebc","Type":"ContainerDied","Data":"9f20530b812315d23c110006cfff938fc387e5b8c4c8ee77af5a61ab8679774f"} Jul 23 18:38:33.040556 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.040501 2580 scope.go:117] "RemoveContainer" containerID="3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100" Jul 23 18:38:33.049374 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.049359 2580 scope.go:117] "RemoveContainer" containerID="4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c" Jul 23 18:38:33.057058 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.057040 2580 scope.go:117] "RemoveContainer" containerID="3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100" Jul 23 18:38:33.057301 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:38:33.057283 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100\": container with ID starting with 3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100 not found: ID does not exist" containerID="3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100" Jul 23 18:38:33.057366 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.057310 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100"} err="failed to get container status \"3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100\": rpc error: code = NotFound desc = could not find container \"3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100\": container with ID starting with 3b6edd27f5b9b30421a6754a3ca6755a83f93eba6eb82149e71e9fef10c32100 not found: ID does not exist" Jul 23 18:38:33.057366 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.057351 2580 scope.go:117] "RemoveContainer" containerID="4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c" Jul 23 18:38:33.057596 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:38:33.057578 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c\": container with ID starting with 4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c not found: ID does not exist" containerID="4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c" Jul 23 18:38:33.057641 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.057602 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c"} err="failed to get container status \"4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c\": rpc error: code = NotFound desc = could not find container \"4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c\": container with ID starting with 4d062bd71a06b9c7a5a960b3f1820bda3beb44016e4fed3c90a70bb30ef3127c not found: ID does not exist" Jul 23 18:38:33.095512 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.095482 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp"] Jul 23 18:38:33.097855 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:33.097833 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a06c87e8-openshift-default-7c97997dd7-bcrjp"] Jul 23 18:38:34.262296 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:38:34.262266 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" path="/var/lib/kubelet/pods/3020cd16-36b3-40cb-9d6d-8d9bea247ebc/volumes" Jul 23 18:39:22.365472 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:22.365436 2580 scope.go:117] "RemoveContainer" containerID="5c11f6c4a7c969dd925b9ef51495b26e3a31df36e9872974e8fd0e8741e6f6dc" Jul 23 18:39:28.797712 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.797678 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj"] Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.797958 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.797969 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.797987 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1820519-fe13-496e-81b2-3817c6215d80" containerName="revoke-keys" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.797992 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1820519-fe13-496e-81b2-3817c6215d80" containerName="revoke-keys" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.798003 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.798009 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.798053 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.798060 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1820519-fe13-496e-81b2-3817c6215d80" containerName="revoke-keys" Jul 23 18:39:28.798148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.798065 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3020cd16-36b3-40cb-9d6d-8d9bea247ebc" containerName="istio-proxy" Jul 23 18:39:28.800661 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.800644 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.803620 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.803593 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-89c000-openshift-default-dockercfg-llt5w\"" Jul 23 18:39:28.814655 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.814632 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj"] Jul 23 18:39:28.869924 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.869889 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7c89\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-kube-api-access-r7c89\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870144 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.869952 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-envoy\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870144 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.870018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istiod-ca-cert\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870144 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.870049 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-token\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870144 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.870096 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-certs\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870144 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.870129 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-podinfo\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870408 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.870168 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-data\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870408 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.870196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-socket\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.870408 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.870230 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-credential-socket\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971694 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-podinfo\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971694 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971693 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-data\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971728 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-socket\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971746 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-credential-socket\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7c89\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-kube-api-access-r7c89\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971825 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-envoy\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istiod-ca-cert\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.971958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.971875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-token\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.972272 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.972001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-certs\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.972272 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.972193 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-credential-socket\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.972272 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.972235 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-socket\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.972453 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.972352 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-certs\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.972672 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.972557 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-data\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.973100 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.973077 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istiod-ca-cert\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.974340 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.974306 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-envoy\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.974560 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.974543 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-podinfo\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.983155 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.983130 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-token\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:28.985707 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:28.985686 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7c89\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-kube-api-access-r7c89\") pod \"e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:29.110080 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:29.109969 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:29.253009 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:29.252976 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj"] Jul 23 18:39:29.255743 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:39:29.255704 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c12091_24ce_42c8_bae9_2b1ad7aaff17.slice/crio-ebbf333253fec5c3199f1af9f9bd1c54561fccd9ca8374d2f413e9b3fa78e729 WatchSource:0}: Error finding container ebbf333253fec5c3199f1af9f9bd1c54561fccd9ca8374d2f413e9b3fa78e729: Status 404 returned error can't find the container with id ebbf333253fec5c3199f1af9f9bd1c54561fccd9ca8374d2f413e9b3fa78e729 Jul 23 18:39:29.258038 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:29.257998 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:29.258102 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:29.258068 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:29.258155 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:29.258102 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:29.279258 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:29.279229 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" event={"ID":"15c12091-24ce-42c8-bae9-2b1ad7aaff17","Type":"ContainerStarted","Data":"ebbf333253fec5c3199f1af9f9bd1c54561fccd9ca8374d2f413e9b3fa78e729"} Jul 23 18:39:30.284856 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:30.284823 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" event={"ID":"15c12091-24ce-42c8-bae9-2b1ad7aaff17","Type":"ContainerStarted","Data":"f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9"} Jul 23 18:39:30.310134 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:30.310081 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" podStartSLOduration=2.310065354 podStartE2EDuration="2.310065354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:30.308368768 +0000 UTC m=+2228.548880441" watchObservedRunningTime="2026-07-23 18:39:30.310065354 +0000 UTC m=+2228.550577033" Jul 23 18:39:31.110721 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:31.110681 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:31.115885 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:31.115857 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:31.289453 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:31.289423 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:31.290360 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:31.290319 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:37.609849 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.609817 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl"] Jul 23 18:39:37.613286 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.613262 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.616470 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.616448 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fa8ad7-openshift-default-dockercfg-ls8qd\"" Jul 23 18:39:37.631498 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.631471 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl"] Jul 23 18:39:37.749212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749176 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-credential-socket\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749212 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749218 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-certs\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749493 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749283 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-data\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749493 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749308 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-podinfo\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749493 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749356 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-socket\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749493 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749411 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istiod-ca-cert\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749493 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvv8w\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-kube-api-access-nvv8w\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749733 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749519 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-envoy\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.749733 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.749545 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-token\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850091 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-data\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850140 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-podinfo\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-socket\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istiod-ca-cert\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850247 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvv8w\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-kube-api-access-nvv8w\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850277 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-envoy\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-token\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850402 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-credential-socket\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850426 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-certs\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.850843 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-certs\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.851079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-data\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.851976 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-socket\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.853148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.852604 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istiod-ca-cert\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.854010 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.853298 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-credential-socket\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.858033 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.857998 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-podinfo\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.874107 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.874022 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvv8w\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-kube-api-access-nvv8w\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.878349 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.875703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-envoy\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.879806 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.879720 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-token\") pod \"e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:37.923573 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:37.923537 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:38.115263 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.115237 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl"] Jul 23 18:39:38.116955 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:39:38.116934 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2884b7f7_4c14_4fdf_934c_2785a3f274ad.slice/crio-da6036c07150259fd64faa31bc2e5ca021511473be96fbc5b9a3c6c3fd64ea19 WatchSource:0}: Error finding container da6036c07150259fd64faa31bc2e5ca021511473be96fbc5b9a3c6c3fd64ea19: Status 404 returned error can't find the container with id da6036c07150259fd64faa31bc2e5ca021511473be96fbc5b9a3c6c3fd64ea19 Jul 23 18:39:38.119008 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.118977 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:38.119056 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.119042 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:38.119090 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.119072 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:38.319203 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.319167 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" event={"ID":"2884b7f7-4c14-4fdf-934c-2785a3f274ad","Type":"ContainerStarted","Data":"e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a"} Jul 23 18:39:38.319413 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.319219 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" event={"ID":"2884b7f7-4c14-4fdf-934c-2785a3f274ad","Type":"ContainerStarted","Data":"da6036c07150259fd64faa31bc2e5ca021511473be96fbc5b9a3c6c3fd64ea19"} Jul 23 18:39:38.367488 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.367426 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" podStartSLOduration=1.367410576 podStartE2EDuration="1.367410576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:39:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:39:38.36704255 +0000 UTC m=+2236.607554232" watchObservedRunningTime="2026-07-23 18:39:38.367410576 +0000 UTC m=+2236.607922256" Jul 23 18:39:38.923847 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:38.923816 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:39.929213 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:39.929181 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:40.327958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:40.327928 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:40.328903 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:40.328885 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:45.350309 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:45.350271 2580 generic.go:356] "Generic (PLEG): container finished" podID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerID="f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9" exitCode=0 Jul 23 18:39:45.350804 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:45.350358 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" event={"ID":"15c12091-24ce-42c8-bae9-2b1ad7aaff17","Type":"ContainerDied","Data":"f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9"} Jul 23 18:39:45.350804 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:45.350764 2580 scope.go:117] "RemoveContainer" containerID="f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9" Jul 23 18:39:45.351757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:45.351720 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:45.351868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:45.351791 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:45.351868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:45.351824 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:46.290050 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:46.290016 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:46.356868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:46.356833 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" event={"ID":"15c12091-24ce-42c8-bae9-2b1ad7aaff17","Type":"ContainerStarted","Data":"d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b"} Jul 23 18:39:47.110910 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:47.110877 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:47.111963 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:47.111942 2580 patch_prober.go:28] interesting pod/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 23 18:39:47.112017 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:47.111992 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 23 18:39:48.110885 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:48.110851 2580 patch_prober.go:28] interesting pod/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 23 18:39:48.111273 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:48.110919 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 23 18:39:49.110631 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:49.110596 2580 patch_prober.go:28] interesting pod/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 23 18:39:49.110795 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:49.110663 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 23 18:39:50.110465 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:50.110423 2580 patch_prober.go:28] interesting pod/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body= Jul 23 18:39:50.110873 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:50.110507 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" Jul 23 18:39:51.114503 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:51.114475 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:51.114919 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:51.114766 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:51.115419 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:51.115401 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:39:55.464036 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:55.463864 2580 patch_prober.go:28] interesting pod/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:60002->10.134.0.31:15021: read: connection reset by peer" start-of-body= Jul 23 18:39:55.464036 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:55.463930 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": read tcp 10.134.0.2:60002->10.134.0.31:15021: read: connection reset by peer" Jul 23 18:39:56.426601 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:56.426560 2580 generic.go:356] "Generic (PLEG): container finished" podID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerID="e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a" exitCode=0 Jul 23 18:39:56.426796 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:56.426636 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" event={"ID":"2884b7f7-4c14-4fdf-934c-2785a3f274ad","Type":"ContainerDied","Data":"e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a"} Jul 23 18:39:56.427060 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:56.427044 2580 scope.go:117] "RemoveContainer" containerID="e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a" Jul 23 18:39:56.428062 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:56.428033 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:56.428114 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:56.428102 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:56.428148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:56.428135 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:39:57.434210 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:57.433348 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" event={"ID":"2884b7f7-4c14-4fdf-934c-2785a3f274ad","Type":"ContainerStarted","Data":"e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5"} Jul 23 18:39:57.923724 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:57.923683 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:39:57.923909 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:57.923893 2580 patch_prober.go:28] interesting pod/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 23 18:39:57.923970 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:57.923950 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 23 18:39:58.924952 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:58.924914 2580 patch_prober.go:28] interesting pod/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 23 18:39:58.925380 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:58.924969 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 23 18:39:59.924514 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:59.924475 2580 patch_prober.go:28] interesting pod/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 23 18:39:59.924696 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:39:59.924533 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 23 18:40:00.924866 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:40:00.924821 2580 patch_prober.go:28] interesting pod/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 23 18:40:00.925379 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:40:00.924892 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 23 18:40:01.927490 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:40:01.927456 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:40:01.927928 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:40:01.927715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:40:01.928293 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:40:01.928272 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:40:22.388745 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:40:22.388718 2580 scope.go:117] "RemoveContainer" containerID="5d6db33615ac0e17020c3f8777070e7f63eda2a2d588151feabe1d028ccc1748" Jul 23 18:41:18.094011 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:18.093879 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj"] Jul 23 18:41:18.094567 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:18.094104 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" containerID="cri-o://d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b" gracePeriod=30 Jul 23 18:41:21.117011 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:21.116965 2580 patch_prober.go:28] interesting pod/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 18:41:21.117429 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:21.117055 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 18:41:23.351868 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.351836 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:41:23.509198 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509162 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-data\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509208 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-credential-socket\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509234 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istiod-ca-cert\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509257 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-socket\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509295 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-podinfo\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509326 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-envoy\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509398 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509391 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7c89\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-kube-api-access-r7c89\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509711 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509455 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-certs\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509711 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509474 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:23.509711 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509487 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-token\") pod \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\" (UID: \"15c12091-24ce-42c8-bae9-2b1ad7aaff17\") " Jul 23 18:41:23.509711 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509670 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:23.509711 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509679 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:41:23.509943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509767 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:23.509943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509902 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.509943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509925 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.509943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509940 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.510075 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.509953 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.510075 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.510037 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-data" (OuterVolumeSpecName: "istio-data") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:23.512396 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.512359 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:23.512517 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.512391 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-token" (OuterVolumeSpecName: "istio-token") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:41:23.512517 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.512440 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-kube-api-access-r7c89" (OuterVolumeSpecName: "kube-api-access-r7c89") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "kube-api-access-r7c89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:41:23.512517 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.512451 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15c12091-24ce-42c8-bae9-2b1ad7aaff17" (UID: "15c12091-24ce-42c8-bae9-2b1ad7aaff17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:41:23.610619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.610579 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.610619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.610611 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.610619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.610620 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.610619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.610629 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15c12091-24ce-42c8-bae9-2b1ad7aaff17-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.610874 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.610638 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7c89\" (UniqueName: \"kubernetes.io/projected/15c12091-24ce-42c8-bae9-2b1ad7aaff17-kube-api-access-r7c89\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:23.824106 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.824013 2580 generic.go:356] "Generic (PLEG): container finished" podID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerID="d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b" exitCode=0 Jul 23 18:41:23.824106 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.824072 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" Jul 23 18:41:23.824311 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.824098 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" event={"ID":"15c12091-24ce-42c8-bae9-2b1ad7aaff17","Type":"ContainerDied","Data":"d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b"} Jul 23 18:41:23.824311 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.824160 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj" event={"ID":"15c12091-24ce-42c8-bae9-2b1ad7aaff17","Type":"ContainerDied","Data":"ebbf333253fec5c3199f1af9f9bd1c54561fccd9ca8374d2f413e9b3fa78e729"} Jul 23 18:41:23.824311 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.824192 2580 scope.go:117] "RemoveContainer" containerID="d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b" Jul 23 18:41:23.833292 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.833271 2580 scope.go:117] "RemoveContainer" containerID="f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9" Jul 23 18:41:23.840906 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.840889 2580 scope.go:117] "RemoveContainer" containerID="d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b" Jul 23 18:41:23.841199 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:41:23.841179 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b\": container with ID starting with d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b not found: ID does not exist" containerID="d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b" Jul 23 18:41:23.841245 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.841208 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b"} err="failed to get container status \"d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b\": rpc error: code = NotFound desc = could not find container \"d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b\": container with ID starting with d4a7a16736281e48ac8d5ebf9f9c49bb4d5a9c0ceffae0efdbf5493f19e3a03b not found: ID does not exist" Jul 23 18:41:23.841245 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.841227 2580 scope.go:117] "RemoveContainer" containerID="f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9" Jul 23 18:41:23.841494 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:41:23.841475 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9\": container with ID starting with f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9 not found: ID does not exist" containerID="f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9" Jul 23 18:41:23.841541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.841501 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9"} err="failed to get container status \"f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9\": rpc error: code = NotFound desc = could not find container \"f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9\": container with ID starting with f210e7012c8add2a305a0c7e50ef017edb44444e08ac96c0ed564f6c6ce272f9 not found: ID does not exist" Jul 23 18:41:23.847427 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.847402 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj"] Jul 23 18:41:23.852041 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:23.852015 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-89c000-openshift-default-b6564ffcc-vw8gj"] Jul 23 18:41:24.262181 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:24.262149 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" path="/var/lib/kubelet/pods/15c12091-24ce-42c8-bae9-2b1ad7aaff17/volumes" Jul 23 18:41:41.426994 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:41.426960 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl"] Jul 23 18:41:41.427404 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:41.427172 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" containerID="cri-o://e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5" gracePeriod=30 Jul 23 18:41:42.440545 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.440506 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd"] Jul 23 18:41:42.440954 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.440939 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" Jul 23 18:41:42.440998 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.440957 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" Jul 23 18:41:42.441051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.441040 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" Jul 23 18:41:42.441086 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.441054 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" Jul 23 18:41:42.444300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.444277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.452412 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.452388 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-63cdc8-openshift-default-dockercfg-jd4jz\"" Jul 23 18:41:42.453871 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.453847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-certs\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.453970 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.453892 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-socket\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.453970 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.453926 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-envoy\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.453970 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.453957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c27f32f-6302-4d45-8098-848ed6ebe1da-istiod-ca-cert\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.454091 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.454005 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-data\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.454091 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.454063 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-token\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.454164 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.454149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-podinfo\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.454213 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.454177 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dr7x\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-kube-api-access-9dr7x\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.454250 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.454209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-credential-socket\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.475359 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.475314 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd"] Jul 23 18:41:42.554940 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.554907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-podinfo\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.554940 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.554943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dr7x\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-kube-api-access-9dr7x\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555195 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.554962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-credential-socket\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555195 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.554997 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-certs\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555195 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555021 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-socket\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555195 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-envoy\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555195 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555061 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c27f32f-6302-4d45-8098-848ed6ebe1da-istiod-ca-cert\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555195 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-data\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555195 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-token\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555580 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555469 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-credential-socket\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555580 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555500 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-certs\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555580 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555531 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-socket\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555720 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555695 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-data\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.555913 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.555892 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c27f32f-6302-4d45-8098-848ed6ebe1da-istiod-ca-cert\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.557682 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.557661 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-envoy\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.557821 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.557803 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-podinfo\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.565796 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.565769 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-token\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.566047 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.566029 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dr7x\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-kube-api-access-9dr7x\") pod \"e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.755585 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.755547 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:42.931681 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.931644 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd"] Jul 23 18:41:42.934663 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:41:42.934625 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c27f32f_6302_4d45_8098_848ed6ebe1da.slice/crio-0a40032ba335104dfc100c22643d783941b1fcc4acceb9e5c9155272fa263c75 WatchSource:0}: Error finding container 0a40032ba335104dfc100c22643d783941b1fcc4acceb9e5c9155272fa263c75: Status 404 returned error can't find the container with id 0a40032ba335104dfc100c22643d783941b1fcc4acceb9e5c9155272fa263c75 Jul 23 18:41:42.936856 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.936824 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:42.936948 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.936895 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:42.936948 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:42.936929 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:43.910239 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:43.910200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" event={"ID":"2c27f32f-6302-4d45-8098-848ed6ebe1da","Type":"ContainerStarted","Data":"a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98"} Jul 23 18:41:43.910672 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:43.910264 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" event={"ID":"2c27f32f-6302-4d45-8098-848ed6ebe1da","Type":"ContainerStarted","Data":"0a40032ba335104dfc100c22643d783941b1fcc4acceb9e5c9155272fa263c75"} Jul 23 18:41:43.952918 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:43.952865 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podStartSLOduration=1.9528494429999999 podStartE2EDuration="1.952849443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:41:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:41:43.952193628 +0000 UTC m=+2362.192705310" watchObservedRunningTime="2026-07-23 18:41:43.952849443 +0000 UTC m=+2362.193361123" Jul 23 18:41:44.756757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:44.756719 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:44.761803 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:44.761775 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:44.915315 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:44.915283 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:44.916408 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:44.916388 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:41:46.687173 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.687147 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:41:46.785578 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785536 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-token\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785578 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785582 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-certs\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785605 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-data\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785629 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-podinfo\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785671 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-credential-socket\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785700 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvv8w\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-kube-api-access-nvv8w\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785727 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-socket\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785759 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istiod-ca-cert\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.785835 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785785 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-envoy\") pod \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\" (UID: \"2884b7f7-4c14-4fdf-934c-2785a3f274ad\") " Jul 23 18:41:46.786160 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.785945 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:46.786160 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.786049 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.786160 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.786109 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:46.786298 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.786185 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:46.786432 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.786411 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:41:46.786686 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.786649 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:46.788192 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.788172 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:41:46.788455 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.788424 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-kube-api-access-nvv8w" (OuterVolumeSpecName: "kube-api-access-nvv8w") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "kube-api-access-nvv8w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:41:46.788579 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.788560 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:41:46.788628 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.788612 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "2884b7f7-4c14-4fdf-934c-2785a3f274ad" (UID: "2884b7f7-4c14-4fdf-934c-2785a3f274ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:41:46.887174 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887133 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.887174 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887168 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.887174 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887182 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.887461 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887195 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.887461 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887208 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvv8w\" (UniqueName: \"kubernetes.io/projected/2884b7f7-4c14-4fdf-934c-2785a3f274ad-kube-api-access-nvv8w\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.887461 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887220 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.887461 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887232 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.887461 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.887245 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2884b7f7-4c14-4fdf-934c-2785a3f274ad-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:41:46.925569 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.925532 2580 generic.go:356] "Generic (PLEG): container finished" podID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerID="e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5" exitCode=0 Jul 23 18:41:46.925755 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.925590 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" Jul 23 18:41:46.925755 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.925621 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" event={"ID":"2884b7f7-4c14-4fdf-934c-2785a3f274ad","Type":"ContainerDied","Data":"e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5"} Jul 23 18:41:46.925755 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.925677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl" event={"ID":"2884b7f7-4c14-4fdf-934c-2785a3f274ad","Type":"ContainerDied","Data":"da6036c07150259fd64faa31bc2e5ca021511473be96fbc5b9a3c6c3fd64ea19"} Jul 23 18:41:46.925755 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.925700 2580 scope.go:117] "RemoveContainer" containerID="e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5" Jul 23 18:41:46.934958 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.934942 2580 scope.go:117] "RemoveContainer" containerID="e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a" Jul 23 18:41:46.943222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.943192 2580 scope.go:117] "RemoveContainer" containerID="e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5" Jul 23 18:41:46.943617 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:41:46.943594 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5\": container with ID starting with e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5 not found: ID does not exist" containerID="e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5" Jul 23 18:41:46.943696 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.943624 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5"} err="failed to get container status \"e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5\": rpc error: code = NotFound desc = could not find container \"e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5\": container with ID starting with e013fa32e158679f0bd6846762f01a02893df200c18afa80da8d09c46b1364a5 not found: ID does not exist" Jul 23 18:41:46.943696 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.943642 2580 scope.go:117] "RemoveContainer" containerID="e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a" Jul 23 18:41:46.943918 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:41:46.943899 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a\": container with ID starting with e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a not found: ID does not exist" containerID="e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a" Jul 23 18:41:46.943960 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.943925 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a"} err="failed to get container status \"e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a\": rpc error: code = NotFound desc = could not find container \"e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a\": container with ID starting with e0a87ca1f9d2aa8e7431ad5c83c246f56c2e2f7da99ea0b61aa697b7beaaa49a not found: ID does not exist" Jul 23 18:41:46.953726 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.953700 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl"] Jul 23 18:41:46.961208 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:46.961176 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fa8ad7-openshift-default-74f8967dd9-z58dl"] Jul 23 18:41:48.267698 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:48.267663 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" path="/var/lib/kubelet/pods/2884b7f7-4c14-4fdf-934c-2785a3f274ad/volumes" Jul 23 18:41:51.515416 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.515384 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689"] Jul 23 18:41:51.516037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.515840 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" Jul 23 18:41:51.516037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.515861 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c12091-24ce-42c8-bae9-2b1ad7aaff17" containerName="istio-proxy" Jul 23 18:41:51.516037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.515895 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" Jul 23 18:41:51.516037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.515905 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" Jul 23 18:41:51.516037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.515923 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" Jul 23 18:41:51.516037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.515933 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" Jul 23 18:41:51.516037 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.516009 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" Jul 23 18:41:51.520419 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.520396 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.523956 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.523929 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-dc83b7-openshift-default-dockercfg-chlj4\"" Jul 23 18:41:51.537871 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.537840 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689"] Jul 23 18:41:51.624000 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.623957 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-credential-socket\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624289 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624256 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgvzc\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-kube-api-access-mgvzc\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624446 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624303 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64017b30-bc6f-46b8-adfe-33f73c732f77-istiod-ca-cert\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624446 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624350 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-certs\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624446 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-envoy\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624624 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-podinfo\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624624 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624543 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-data\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624624 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-socket\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.624624 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.624615 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-token\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.725703 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725663 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-podinfo\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.725893 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-data\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.725893 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725757 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-socket\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.725893 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-token\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.725893 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-credential-socket\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.725893 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgvzc\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-kube-api-access-mgvzc\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.725893 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725888 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64017b30-bc6f-46b8-adfe-33f73c732f77-istiod-ca-cert\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.726222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725914 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-certs\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.726222 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.725969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-envoy\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.726367 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.726219 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-socket\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.726367 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.726246 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-data\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.726489 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.726371 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-credential-socket\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.726489 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.726476 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-certs\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.726741 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.726683 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64017b30-bc6f-46b8-adfe-33f73c732f77-istiod-ca-cert\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.728245 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.728220 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-envoy\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.728371 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.728258 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-podinfo\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.736908 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.736883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgvzc\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-kube-api-access-mgvzc\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.737150 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.737134 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-token\") pod \"e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.830800 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.830706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:51.985177 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.985151 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689"] Jul 23 18:41:51.987729 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:41:51.987694 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64017b30_bc6f_46b8_adfe_33f73c732f77.slice/crio-a162ecd8df74fed0a9b0066f1610cf9f18c91650dded7c7dabd9f84422cbccd0 WatchSource:0}: Error finding container a162ecd8df74fed0a9b0066f1610cf9f18c91650dded7c7dabd9f84422cbccd0: Status 404 returned error can't find the container with id a162ecd8df74fed0a9b0066f1610cf9f18c91650dded7c7dabd9f84422cbccd0 Jul 23 18:41:51.989911 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.989873 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:51.990009 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.989966 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:51.990072 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:51.990022 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:52.957609 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:52.957564 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" event={"ID":"64017b30-bc6f-46b8-adfe-33f73c732f77","Type":"ContainerStarted","Data":"8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff"} Jul 23 18:41:52.958113 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:52.957631 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" event={"ID":"64017b30-bc6f-46b8-adfe-33f73c732f77","Type":"ContainerStarted","Data":"a162ecd8df74fed0a9b0066f1610cf9f18c91650dded7c7dabd9f84422cbccd0"} Jul 23 18:41:52.985411 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:52.985354 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" podStartSLOduration=1.985314256 podStartE2EDuration="1.985314256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:41:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:41:52.98341482 +0000 UTC m=+2371.223926500" watchObservedRunningTime="2026-07-23 18:41:52.985314256 +0000 UTC m=+2371.225825935" Jul 23 18:41:53.831603 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:53.831563 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:53.848005 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:53.847969 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:53.961706 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:53.961679 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:53.963004 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:53.962898 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:41:59.917102 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.917017 2580 patch_prober.go:28] interesting pod/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 23 18:41:59.917102 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.917072 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 23 18:41:59.988559 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.988525 2580 generic.go:356] "Generic (PLEG): container finished" podID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerID="a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98" exitCode=0 Jul 23 18:41:59.988730 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.988596 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" event={"ID":"2c27f32f-6302-4d45-8098-848ed6ebe1da","Type":"ContainerDied","Data":"a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98"} Jul 23 18:41:59.988974 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.988961 2580 scope.go:117] "RemoveContainer" containerID="a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98" Jul 23 18:41:59.989945 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.989915 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:59.990005 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.989989 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:41:59.990055 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:41:59.990019 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:42:00.994971 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:00.994936 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" event={"ID":"2c27f32f-6302-4d45-8098-848ed6ebe1da","Type":"ContainerStarted","Data":"611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6"} Jul 23 18:42:01.756978 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:01.756896 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:42:01.756978 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:01.756931 2580 patch_prober.go:28] interesting pod/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 23 18:42:01.756978 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:01.756978 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 23 18:42:02.756358 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:02.756294 2580 patch_prober.go:28] interesting pod/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 23 18:42:02.756871 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:02.756392 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 23 18:42:03.756619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:03.756575 2580 patch_prober.go:28] interesting pod/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 23 18:42:03.757241 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:03.757189 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 23 18:42:04.756151 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:04.756099 2580 patch_prober.go:28] interesting pod/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 23 18:42:04.756403 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:04.756178 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 23 18:42:05.760636 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:05.760598 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:42:05.761219 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:05.761192 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:42:05.762007 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:05.761986 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:42:09.039588 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:09.039497 2580 patch_prober.go:28] interesting pod/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": read tcp 10.134.0.2:57856->10.134.0.33:15021: read: connection reset by peer" start-of-body= Jul 23 18:42:09.039968 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:09.039581 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": read tcp 10.134.0.2:57856->10.134.0.33:15021: read: connection reset by peer" Jul 23 18:42:10.035764 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:10.035720 2580 generic.go:356] "Generic (PLEG): container finished" podID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerID="8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff" exitCode=0 Jul 23 18:42:10.035764 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:10.035767 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" event={"ID":"64017b30-bc6f-46b8-adfe-33f73c732f77","Type":"ContainerDied","Data":"8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff"} Jul 23 18:42:10.036143 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:10.036129 2580 scope.go:117] "RemoveContainer" containerID="8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff" Jul 23 18:42:10.037119 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:10.037085 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:42:10.037214 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:10.037157 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:42:10.037214 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:10.037193 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:42:11.042198 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:11.042156 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" event={"ID":"64017b30-bc6f-46b8-adfe-33f73c732f77","Type":"ContainerStarted","Data":"87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0"} Jul 23 18:42:11.831499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:11.831464 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:42:11.831695 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:11.831672 2580 patch_prober.go:28] interesting pod/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 23 18:42:11.831740 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:11.831721 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 23 18:42:12.831560 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:12.831521 2580 patch_prober.go:28] interesting pod/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 23 18:42:12.831977 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:12.831585 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 23 18:42:13.832093 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:13.832052 2580 patch_prober.go:28] interesting pod/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 23 18:42:13.832594 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:13.832127 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 23 18:42:14.831473 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:14.831439 2580 patch_prober.go:28] interesting pod/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body= Jul 23 18:42:14.831663 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:14.831513 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" Jul 23 18:42:15.835376 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:15.835325 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:42:15.835765 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:15.835688 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:42:15.836239 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:15.836219 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:42:35.362761 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:35.362726 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd"] Jul 23 18:42:35.363191 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:35.362948 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" containerID="cri-o://611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6" gracePeriod=30 Jul 23 18:42:35.764180 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:35.764148 2580 patch_prober.go:28] interesting pod/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 23 18:42:35.764388 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:35.764206 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 18:42:40.617299 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.617274 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:42:40.690854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.690765 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-credential-socket\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.690854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.690813 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-data\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691081 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.690861 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-envoy\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691081 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.690887 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dr7x\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-kube-api-access-9dr7x\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691081 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.690911 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-podinfo\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691081 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.690949 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-certs\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691283 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691086 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-token\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691283 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691091 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:42:40.691283 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691267 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-socket\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691283 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691272 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:42:40.691527 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691292 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c27f32f-6302-4d45-8098-848ed6ebe1da-istiod-ca-cert\") pod \"2c27f32f-6302-4d45-8098-848ed6ebe1da\" (UID: \"2c27f32f-6302-4d45-8098-848ed6ebe1da\") " Jul 23 18:42:40.691527 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691497 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:42:40.691620 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691600 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c27f32f-6302-4d45-8098-848ed6ebe1da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:42:40.691828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691805 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:42:40.691889 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691876 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.691965 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691895 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c27f32f-6302-4d45-8098-848ed6ebe1da-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.691965 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691906 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.691965 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691915 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.691965 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.691925 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.693927 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.693899 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:42:40.693927 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.693907 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-kube-api-access-9dr7x" (OuterVolumeSpecName: "kube-api-access-9dr7x") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "kube-api-access-9dr7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:42:40.693927 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.693919 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:42:40.694105 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.693913 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c27f32f-6302-4d45-8098-848ed6ebe1da" (UID: "2c27f32f-6302-4d45-8098-848ed6ebe1da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:42:40.792853 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.792800 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.792853 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.792845 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.792853 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.792859 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dr7x\" (UniqueName: \"kubernetes.io/projected/2c27f32f-6302-4d45-8098-848ed6ebe1da-kube-api-access-9dr7x\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:40.793086 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:40.792873 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c27f32f-6302-4d45-8098-848ed6ebe1da-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:42:41.180810 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.180776 2580 generic.go:356] "Generic (PLEG): container finished" podID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerID="611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6" exitCode=0 Jul 23 18:42:41.180980 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.180825 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" Jul 23 18:42:41.180980 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.180841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" event={"ID":"2c27f32f-6302-4d45-8098-848ed6ebe1da","Type":"ContainerDied","Data":"611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6"} Jul 23 18:42:41.180980 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.180884 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd" event={"ID":"2c27f32f-6302-4d45-8098-848ed6ebe1da","Type":"ContainerDied","Data":"0a40032ba335104dfc100c22643d783941b1fcc4acceb9e5c9155272fa263c75"} Jul 23 18:42:41.180980 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.180906 2580 scope.go:117] "RemoveContainer" containerID="611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6" Jul 23 18:42:41.190291 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.190269 2580 scope.go:117] "RemoveContainer" containerID="a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98" Jul 23 18:42:41.198504 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.198484 2580 scope.go:117] "RemoveContainer" containerID="611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6" Jul 23 18:42:41.198770 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:42:41.198746 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6\": container with ID starting with 611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6 not found: ID does not exist" containerID="611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6" Jul 23 18:42:41.198846 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.198784 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6"} err="failed to get container status \"611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6\": rpc error: code = NotFound desc = could not find container \"611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6\": container with ID starting with 611dbdde3c9f42d4127544554c33b1f9f32b0b2db8c3694822bb28c92b1e8bb6 not found: ID does not exist" Jul 23 18:42:41.198846 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.198810 2580 scope.go:117] "RemoveContainer" containerID="a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98" Jul 23 18:42:41.199090 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:42:41.199070 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98\": container with ID starting with a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98 not found: ID does not exist" containerID="a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98" Jul 23 18:42:41.199127 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.199097 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98"} err="failed to get container status \"a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98\": rpc error: code = NotFound desc = could not find container \"a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98\": container with ID starting with a548aa720298988db113406739579a5bf754b672ca9e2af90b34bb7be6e0ef98 not found: ID does not exist" Jul 23 18:42:41.205187 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.205161 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd"] Jul 23 18:42:41.211048 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:41.211026 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-63cdc8-openshift-default-74c488cf4f-fwfkd"] Jul 23 18:42:42.262036 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:42:42.261998 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" path="/var/lib/kubelet/pods/2c27f32f-6302-4d45-8098-848ed6ebe1da/volumes" Jul 23 18:43:03.719449 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:03.719354 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689"] Jul 23 18:43:03.720021 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:03.719605 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" containerID="cri-o://87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0" gracePeriod=30 Jul 23 18:43:04.724504 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724470 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc"] Jul 23 18:43:04.724959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724791 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" Jul 23 18:43:04.724959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724801 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" Jul 23 18:43:04.724959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724811 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" Jul 23 18:43:04.724959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724816 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" Jul 23 18:43:04.724959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724862 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" Jul 23 18:43:04.724959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724869 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2884b7f7-4c14-4fdf-934c-2785a3f274ad" containerName="istio-proxy" Jul 23 18:43:04.724959 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.724878 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c27f32f-6302-4d45-8098-848ed6ebe1da" containerName="istio-proxy" Jul 23 18:43:04.727609 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.727593 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.731157 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.731135 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d87a73-openshift-default-dockercfg-t4kl2\"" Jul 23 18:43:04.745274 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.745242 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc"] Jul 23 18:43:04.906242 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906203 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-envoy\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906242 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2nnl\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-kube-api-access-w2nnl\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906531 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-certs\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906531 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906361 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-socket\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906531 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906395 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c47a93a-11e0-4885-937a-f5abde30ee4a-istiod-ca-cert\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906531 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906416 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-token\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906531 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-credential-socket\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906531 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906505 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-data\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:04.906740 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:04.906538 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-podinfo\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.007594 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-certs\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.007802 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007598 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-socket\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.007802 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007627 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c47a93a-11e0-4885-937a-f5abde30ee4a-istiod-ca-cert\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.007802 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007654 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-token\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.007802 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-credential-socket\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.007802 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007734 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-data\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.007802 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007773 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-podinfo\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.008106 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-envoy\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.008106 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.007866 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2nnl\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-kube-api-access-w2nnl\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.008106 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.008027 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-certs\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.008106 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.008061 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-socket\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.008248 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.008155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-credential-socket\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.008300 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.008279 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-data\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.008419 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.008373 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c47a93a-11e0-4885-937a-f5abde30ee4a-istiod-ca-cert\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.010317 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.010295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-envoy\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.010655 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.010631 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-podinfo\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.018905 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.018871 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2nnl\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-kube-api-access-w2nnl\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.019542 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.019523 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-token\") pod \"e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.037495 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.037474 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:05.191196 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.191166 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc"] Jul 23 18:43:05.194272 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:43:05.194239 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c47a93a_11e0_4885_937a_f5abde30ee4a.slice/crio-db504fd246b28487d0f20a3e3cf0043b7a6a93c60e7617bb37549e174af11ece WatchSource:0}: Error finding container db504fd246b28487d0f20a3e3cf0043b7a6a93c60e7617bb37549e174af11ece: Status 404 returned error can't find the container with id db504fd246b28487d0f20a3e3cf0043b7a6a93c60e7617bb37549e174af11ece Jul 23 18:43:05.196410 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.196375 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:05.196475 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.196466 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:05.196512 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.196496 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:05.283645 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.283569 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" event={"ID":"9c47a93a-11e0-4885-937a-f5abde30ee4a","Type":"ContainerStarted","Data":"16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b"} Jul 23 18:43:05.283645 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.283627 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" event={"ID":"9c47a93a-11e0-4885-937a-f5abde30ee4a","Type":"ContainerStarted","Data":"db504fd246b28487d0f20a3e3cf0043b7a6a93c60e7617bb37549e174af11ece"} Jul 23 18:43:05.311506 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:05.311436 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" podStartSLOduration=1.311387968 podStartE2EDuration="1.311387968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:05.310015504 +0000 UTC m=+2443.550527185" watchObservedRunningTime="2026-07-23 18:43:05.311387968 +0000 UTC m=+2443.551899649" Jul 23 18:43:06.038117 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:06.038077 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:06.042836 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:06.042810 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:06.288797 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:06.288719 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:06.289619 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:06.289601 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:08.966730 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:08.966699 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:43:09.043620 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043581 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-certs\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.043828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043637 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-credential-socket\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.043828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043662 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-envoy\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.043828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043691 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-data\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.043828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043714 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64017b30-bc6f-46b8-adfe-33f73c732f77-istiod-ca-cert\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.043828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043731 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-socket\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.043828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043799 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-podinfo\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.043828 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043831 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgvzc\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-kube-api-access-mgvzc\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.044467 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043865 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-token\") pod \"64017b30-bc6f-46b8-adfe-33f73c732f77\" (UID: \"64017b30-bc6f-46b8-adfe-33f73c732f77\") " Jul 23 18:43:09.044467 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043938 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:43:09.044467 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.043964 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:43:09.044467 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.044139 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:43:09.044467 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.044160 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.044467 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.044181 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.044467 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.044192 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64017b30-bc6f-46b8-adfe-33f73c732f77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:43:09.045000 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.044728 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-data" (OuterVolumeSpecName: "istio-data") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:43:09.046148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.046117 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-token" (OuterVolumeSpecName: "istio-token") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:43:09.046268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.046249 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-kube-api-access-mgvzc" (OuterVolumeSpecName: "kube-api-access-mgvzc") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "kube-api-access-mgvzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:43:09.046478 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.046455 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:43:09.046564 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.046546 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64017b30-bc6f-46b8-adfe-33f73c732f77" (UID: "64017b30-bc6f-46b8-adfe-33f73c732f77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:43:09.145499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.145458 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.145499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.145488 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.145499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.145497 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64017b30-bc6f-46b8-adfe-33f73c732f77-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.145499 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.145505 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64017b30-bc6f-46b8-adfe-33f73c732f77-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.145771 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.145516 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.145771 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.145525 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgvzc\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-kube-api-access-mgvzc\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.145771 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.145534 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64017b30-bc6f-46b8-adfe-33f73c732f77-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:43:09.303435 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.303326 2580 generic.go:356] "Generic (PLEG): container finished" podID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerID="87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0" exitCode=0 Jul 23 18:43:09.303435 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.303360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" event={"ID":"64017b30-bc6f-46b8-adfe-33f73c732f77","Type":"ContainerDied","Data":"87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0"} Jul 23 18:43:09.303435 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.303396 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" Jul 23 18:43:09.303435 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.303419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689" event={"ID":"64017b30-bc6f-46b8-adfe-33f73c732f77","Type":"ContainerDied","Data":"a162ecd8df74fed0a9b0066f1610cf9f18c91650dded7c7dabd9f84422cbccd0"} Jul 23 18:43:09.303746 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.303442 2580 scope.go:117] "RemoveContainer" containerID="87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0" Jul 23 18:43:09.312242 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.312225 2580 scope.go:117] "RemoveContainer" containerID="8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff" Jul 23 18:43:09.319626 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.319610 2580 scope.go:117] "RemoveContainer" containerID="87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0" Jul 23 18:43:09.319886 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:43:09.319857 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0\": container with ID starting with 87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0 not found: ID does not exist" containerID="87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0" Jul 23 18:43:09.319972 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.319892 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0"} err="failed to get container status \"87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0\": rpc error: code = NotFound desc = could not find container \"87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0\": container with ID starting with 87573ef391862720580fb2effb1b0f18bc48712807f84d1da5c5edb5d19be3c0 not found: ID does not exist" Jul 23 18:43:09.319972 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.319916 2580 scope.go:117] "RemoveContainer" containerID="8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff" Jul 23 18:43:09.320154 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:43:09.320136 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff\": container with ID starting with 8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff not found: ID does not exist" containerID="8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff" Jul 23 18:43:09.320194 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.320161 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff"} err="failed to get container status \"8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff\": rpc error: code = NotFound desc = could not find container \"8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff\": container with ID starting with 8d6a1de8d8ce2a5e77858c2c4c02cb142ff37000321f2b46104a303c56977aff not found: ID does not exist" Jul 23 18:43:09.327117 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.327093 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689"] Jul 23 18:43:09.333220 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:09.333200 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-dc83b7-openshift-default-cb6b74f6c-md689"] Jul 23 18:43:10.263386 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:10.263322 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" path="/var/lib/kubelet/pods/64017b30-bc6f-46b8-adfe-33f73c732f77/volumes" Jul 23 18:43:12.556701 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.556673 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg"] Jul 23 18:43:12.557067 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.556956 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" Jul 23 18:43:12.557067 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.556966 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" Jul 23 18:43:12.557067 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.557039 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" Jul 23 18:43:12.561225 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.561208 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.567081 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.567048 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-118a8c-openshift-default-dockercfg-vrhvv\"" Jul 23 18:43:12.570792 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.570773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-socket\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.570885 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.570798 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-certs\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.570885 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.570824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-data\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.570885 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.570838 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-token\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.571051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.570901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ffkx\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-kube-api-access-8ffkx\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.571051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.570980 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istiod-ca-cert\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.571051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.571018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-podinfo\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.571187 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.571065 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-envoy\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.571187 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.571092 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-credential-socket\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.581506 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.581472 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg"] Jul 23 18:43:12.672185 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-envoy\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672185 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-credential-socket\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672251 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-socket\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-certs\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-data\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672361 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-token\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672393 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ffkx\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-kube-api-access-8ffkx\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672446 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istiod-ca-cert\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.672502 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.672480 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-podinfo\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.673184 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.673160 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-certs\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.674136 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.673237 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-credential-socket\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.674287 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.673820 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-socket\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.674287 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.674079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-data\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.674569 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.674506 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istiod-ca-cert\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.676201 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.675966 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-podinfo\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.676840 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.676816 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-envoy\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.685055 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.685033 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ffkx\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-kube-api-access-8ffkx\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.687174 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.687153 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-token\") pod \"e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:12.871404 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:12.871302 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:13.017914 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.017888 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg"] Jul 23 18:43:13.019420 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:43:13.019391 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb9afcd9_4cb9_42b0_bb50_d5cc7418a0c3.slice/crio-6f21fd59e6a4050840e0a9b9e10526c6f5392e45edf5c8f7ec387441cdaa7740 WatchSource:0}: Error finding container 6f21fd59e6a4050840e0a9b9e10526c6f5392e45edf5c8f7ec387441cdaa7740: Status 404 returned error can't find the container with id 6f21fd59e6a4050840e0a9b9e10526c6f5392e45edf5c8f7ec387441cdaa7740 Jul 23 18:43:13.021581 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.021548 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:13.021658 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.021617 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:13.021658 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.021645 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:13.322548 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.322512 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" event={"ID":"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3","Type":"ContainerStarted","Data":"9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850"} Jul 23 18:43:13.322752 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.322563 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" event={"ID":"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3","Type":"ContainerStarted","Data":"6f21fd59e6a4050840e0a9b9e10526c6f5392e45edf5c8f7ec387441cdaa7740"} Jul 23 18:43:13.348704 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.348643 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" podStartSLOduration=1.3486240139999999 podStartE2EDuration="1.348624014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:43:13.347177325 +0000 UTC m=+2451.587689006" watchObservedRunningTime="2026-07-23 18:43:13.348624014 +0000 UTC m=+2451.589135696" Jul 23 18:43:13.872280 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:13.872248 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:14.876940 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:14.876911 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:15.330791 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:15.330759 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:15.331845 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:15.331821 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:22.330598 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:22.330548 2580 patch_prober.go:28] interesting pod/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 23 18:43:22.331005 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:22.330652 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 23 18:43:22.427728 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:22.427689 2580 scope.go:117] "RemoveContainer" containerID="4cc1e55a4f19cf9aa7c4185756c05bc0bbda731a8761604b3fd1541754b7761b" Jul 23 18:43:24.381543 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:24.381505 2580 generic.go:356] "Generic (PLEG): container finished" podID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerID="16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b" exitCode=0 Jul 23 18:43:24.382080 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:24.381583 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" event={"ID":"9c47a93a-11e0-4885-937a-f5abde30ee4a","Type":"ContainerDied","Data":"16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b"} Jul 23 18:43:24.382080 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:24.382075 2580 scope.go:117] "RemoveContainer" containerID="16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b" Jul 23 18:43:24.383048 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:24.383021 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:24.383110 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:24.383085 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:24.383151 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:24.383119 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:25.389592 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:25.389561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" event={"ID":"9c47a93a-11e0-4885-937a-f5abde30ee4a","Type":"ContainerStarted","Data":"d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1"} Jul 23 18:43:26.038507 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:26.038472 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:26.038961 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:26.038834 2580 patch_prober.go:28] interesting pod/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 23 18:43:26.039163 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:26.039137 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 23 18:43:27.038713 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:27.038672 2580 patch_prober.go:28] interesting pod/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 23 18:43:27.039358 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:27.039304 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 23 18:43:28.038056 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:28.038006 2580 patch_prober.go:28] interesting pod/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 23 18:43:28.038266 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:28.038076 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 23 18:43:29.038397 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:29.038358 2580 patch_prober.go:28] interesting pod/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body= Jul 23 18:43:29.038896 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:29.038429 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" Jul 23 18:43:30.041905 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:30.041870 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:30.042451 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:30.042432 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:30.043013 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:30.042987 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:43:30.779697 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:30.779526 2580 patch_prober.go:28] interesting pod/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": read tcp 10.134.0.2:58096->10.134.0.35:15021: read: connection reset by peer" start-of-body= Jul 23 18:43:30.779697 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:30.779592 2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": read tcp 10.134.0.2:58096->10.134.0.35:15021: read: connection reset by peer" Jul 23 18:43:31.416541 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:31.416507 2580 generic.go:356] "Generic (PLEG): container finished" podID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerID="9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850" exitCode=0 Jul 23 18:43:31.416970 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:31.416580 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" event={"ID":"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3","Type":"ContainerDied","Data":"9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850"} Jul 23 18:43:31.417039 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:31.417022 2580 scope.go:117] "RemoveContainer" containerID="9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850" Jul 23 18:43:31.418062 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:31.418031 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:31.418186 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:31.418100 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:31.418186 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:31.418133 2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 23 18:43:32.424043 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:32.424007 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" event={"ID":"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3","Type":"ContainerStarted","Data":"f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e"} Jul 23 18:43:32.872489 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:32.872449 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:32.872756 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:32.872732 2580 patch_prober.go:28] interesting pod/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 23 18:43:32.872847 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:32.872788 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 23 18:43:33.872740 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:33.872701 2580 patch_prober.go:28] interesting pod/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 23 18:43:33.873158 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:33.872771 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 23 18:43:34.872015 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:34.871978 2580 patch_prober.go:28] interesting pod/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 23 18:43:34.872278 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:34.872031 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 23 18:43:35.872083 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:35.872044 2580 patch_prober.go:28] interesting pod/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body= Jul 23 18:43:35.872508 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:35.872105 2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" Jul 23 18:43:36.875485 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:36.875447 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:36.875878 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:36.875716 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:43:36.876293 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:43:36.876278 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:50:23.398921 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:23.398883 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc"] Jul 23 18:50:23.399410 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:23.399164 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" containerID="cri-o://d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1" gracePeriod=30 Jul 23 18:50:28.648672 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.648646 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:50:28.703956 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.703872 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-token\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.703956 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.703919 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-credential-socket\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.703956 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.703954 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-podinfo\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.704244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.703982 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c47a93a-11e0-4885-937a-f5abde30ee4a-istiod-ca-cert\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.704244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704009 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-data\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.704244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704043 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-socket\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.704244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704107 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-envoy\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.704244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704133 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-certs\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.704244 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704169 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2nnl\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-kube-api-access-w2nnl\") pod \"9c47a93a-11e0-4885-937a-f5abde30ee4a\" (UID: \"9c47a93a-11e0-4885-937a-f5abde30ee4a\") " Jul 23 18:50:28.704564 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704446 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:28.704564 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704542 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:28.704721 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704686 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:28.704721 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.704632 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c47a93a-11e0-4885-937a-f5abde30ee4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:50:28.705146 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.705059 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:28.706590 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.706564 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:50:28.706690 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.706564 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:28.706690 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.706629 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:50:28.706690 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.706674 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-kube-api-access-w2nnl" (OuterVolumeSpecName: "kube-api-access-w2nnl") pod "9c47a93a-11e0-4885-937a-f5abde30ee4a" (UID: "9c47a93a-11e0-4885-937a-f5abde30ee4a"). InnerVolumeSpecName "kube-api-access-w2nnl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:50:28.805152 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805112 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805152 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805145 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805152 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805160 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805445 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805172 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2nnl\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-kube-api-access-w2nnl\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805445 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805183 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805445 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805194 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805445 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805205 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805445 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805216 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c47a93a-11e0-4885-937a-f5abde30ee4a-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:28.805445 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:28.805226 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c47a93a-11e0-4885-937a-f5abde30ee4a-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:29.170757 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.170726 2580 generic.go:356] "Generic (PLEG): container finished" podID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerID="d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1" exitCode=0 Jul 23 18:50:29.170943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.170774 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" Jul 23 18:50:29.170943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.170794 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" event={"ID":"9c47a93a-11e0-4885-937a-f5abde30ee4a","Type":"ContainerDied","Data":"d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1"} Jul 23 18:50:29.170943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.170836 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc" event={"ID":"9c47a93a-11e0-4885-937a-f5abde30ee4a","Type":"ContainerDied","Data":"db504fd246b28487d0f20a3e3cf0043b7a6a93c60e7617bb37549e174af11ece"} Jul 23 18:50:29.170943 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.170856 2580 scope.go:117] "RemoveContainer" containerID="d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1" Jul 23 18:50:29.179454 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.179435 2580 scope.go:117] "RemoveContainer" containerID="16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b" Jul 23 18:50:29.186832 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.186813 2580 scope.go:117] "RemoveContainer" containerID="d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1" Jul 23 18:50:29.187082 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:50:29.187063 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1\": container with ID starting with d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1 not found: ID does not exist" containerID="d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1" Jul 23 18:50:29.187134 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.187090 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1"} err="failed to get container status \"d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1\": rpc error: code = NotFound desc = could not find container \"d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1\": container with ID starting with d28be9681b71c0a5659d80bacaf67d73f6e767441367069ae09fbfb11b771ee1 not found: ID does not exist" Jul 23 18:50:29.187134 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.187110 2580 scope.go:117] "RemoveContainer" containerID="16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b" Jul 23 18:50:29.187321 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:50:29.187305 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b\": container with ID starting with 16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b not found: ID does not exist" containerID="16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b" Jul 23 18:50:29.187381 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.187325 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b"} err="failed to get container status \"16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b\": rpc error: code = NotFound desc = could not find container \"16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b\": container with ID starting with 16833404d840d851129cab14c8f9f56da6d4b9f961f0b14afdd6d2d1c724b32b not found: ID does not exist" Jul 23 18:50:29.201130 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.201107 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc"] Jul 23 18:50:29.202901 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:29.202882 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d87a73-openshift-default-f564f4bc-l6jcc"] Jul 23 18:50:30.262350 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:30.262300 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" path="/var/lib/kubelet/pods/9c47a93a-11e0-4885-937a-f5abde30ee4a/volumes" Jul 23 18:50:45.856350 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:45.856303 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg"] Jul 23 18:50:45.856766 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:45.856528 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" containerID="cri-o://f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e" gracePeriod=30 Jul 23 18:50:51.099785 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.099759 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:50:51.168580 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168486 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-envoy\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168580 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168547 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-socket\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168580 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168570 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istiod-ca-cert\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168607 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-token\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168637 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-podinfo\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168667 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-certs\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168688 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-data\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168722 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ffkx\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-kube-api-access-8ffkx\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.168854 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.168755 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-credential-socket\") pod \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\" (UID: \"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3\") " Jul 23 18:50:51.169140 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.169018 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:51.169140 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.169055 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:51.169249 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.169198 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:51.169446 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.169350 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:50:51.169830 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.169725 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:51.171009 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.170984 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:50:51.171099 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.171046 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 23 18:50:51.171143 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.171114 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:50:51.171178 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.171138 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-kube-api-access-8ffkx" (OuterVolumeSpecName: "kube-api-access-8ffkx") pod "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" (UID: "cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3"). InnerVolumeSpecName "kube-api-access-8ffkx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:50:51.269443 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269410 2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-credential-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269443 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269440 2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-envoy\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269455 2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-socket\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269466 2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istiod-ca-cert\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269474 2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-token\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269482 2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-podinfo\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269489 2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-workload-certs\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269497 2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-istio-data\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.269727 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.269505 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ffkx\" (UniqueName: \"kubernetes.io/projected/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3-kube-api-access-8ffkx\") on node \"ip-10-0-134-130.ec2.internal\" DevicePath \"\"" Jul 23 18:50:51.270172 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.270147 2580 generic.go:356] "Generic (PLEG): container finished" podID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerID="f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e" exitCode=0 Jul 23 18:50:51.270230 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.270196 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" Jul 23 18:50:51.270268 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.270234 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" event={"ID":"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3","Type":"ContainerDied","Data":"f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e"} Jul 23 18:50:51.270302 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.270287 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg" event={"ID":"cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3","Type":"ContainerDied","Data":"6f21fd59e6a4050840e0a9b9e10526c6f5392e45edf5c8f7ec387441cdaa7740"} Jul 23 18:50:51.270363 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.270308 2580 scope.go:117] "RemoveContainer" containerID="f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e" Jul 23 18:50:51.279545 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.279530 2580 scope.go:117] "RemoveContainer" containerID="9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850" Jul 23 18:50:51.287490 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.287472 2580 scope.go:117] "RemoveContainer" containerID="f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e" Jul 23 18:50:51.287738 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:50:51.287722 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e\": container with ID starting with f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e not found: ID does not exist" containerID="f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e" Jul 23 18:50:51.287782 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.287745 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e"} err="failed to get container status \"f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e\": rpc error: code = NotFound desc = could not find container \"f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e\": container with ID starting with f0dc2b8243d98d8ac16cdb454e30f1ae745532f80b12bd9145d01c084740753e not found: ID does not exist" Jul 23 18:50:51.287782 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.287760 2580 scope.go:117] "RemoveContainer" containerID="9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850" Jul 23 18:50:51.287971 ip-10-0-134-130 kubenswrapper[2580]: E0723 18:50:51.287955 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850\": container with ID starting with 9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850 not found: ID does not exist" containerID="9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850" Jul 23 18:50:51.288007 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.287975 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850"} err="failed to get container status \"9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850\": rpc error: code = NotFound desc = could not find container \"9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850\": container with ID starting with 9c926a84cda2b4d0b73222b8d700c82a4fe7e27fd381f23a8cf039d6bbc36850 not found: ID does not exist" Jul 23 18:50:51.294643 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.294620 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg"] Jul 23 18:50:51.299374 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:51.299314 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-118a8c-openshift-default-74dfcf6b9f-6dszg"] Jul 23 18:50:52.263534 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:52.263497 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" path="/var/lib/kubelet/pods/cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3/volumes" Jul 23 18:50:53.027861 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:53.027833 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg_4eac455f-2366-478c-9019-53913c1300d4/copy-manifests/0.log" Jul 23 18:50:53.037456 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:53.037431 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg_4eac455f-2366-478c-9019-53913c1300d4/manager/0.log" Jul 23 18:50:54.253164 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:54.253129 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-cnqw2_20508d9c-520f-4763-bbaf-1c7120014d8f/postgres/0.log" Jul 23 18:50:56.956414 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:56.956382 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48lb89_5b4e9c4b-bef9-479a-88a6-5e1b28153445/istio-proxy/0.log" Jul 23 18:50:57.093281 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:57.093241 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6tl4_0b3ba082-91f8-4751-a8d6-bf413b6f8c95/discovery/0.log" Jul 23 18:50:58.407385 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:58.407352 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-kzb4f_b8865f0d-d90f-4e8b-a182-5bd207879c8f/main/0.log" Jul 23 18:50:58.657167 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:50:58.657130 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkpl69_177591a6-d1f4-4abc-a4db-b8e185a1138e/main/0.log" Jul 23 18:51:08.030350 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:08.030293 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-z8kbh_97e7e893-89fd-455e-8475-0a13f62ee46c/global-pull-secret-syncer/0.log" Jul 23 18:51:08.151003 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:08.150965 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qv67x_a615b62f-62de-45c8-9bf1-db84109bf36a/konnectivity-agent/0.log" Jul 23 18:51:08.216756 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:08.216724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-130.ec2.internal_68a6a4a068480f33d4378a102cee2ec2/haproxy/0.log" Jul 23 18:51:16.662355 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:16.662312 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7trkx_59f57fe5-e5bf-46a1-9c29-dd7982ae4d40/node-exporter/0.log" Jul 23 18:51:16.696927 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:16.696902 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7trkx_59f57fe5-e5bf-46a1-9c29-dd7982ae4d40/kube-rbac-proxy/0.log" Jul 23 18:51:16.733298 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:16.733275 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7trkx_59f57fe5-e5bf-46a1-9c29-dd7982ae4d40/init-textfile/0.log" Jul 23 18:51:18.389703 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.389670 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv"] Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.389957 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.389968 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.389978 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.389984 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.389993 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.389999 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390006 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390011 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390022 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" Jul 23 18:51:18.390051 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390027 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" Jul 23 18:51:18.390381 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390069 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb9afcd9-4cb9-42b0-bb50-d5cc7418a0c3" containerName="istio-proxy" Jul 23 18:51:18.390381 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390077 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" Jul 23 18:51:18.390381 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390084 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="64017b30-bc6f-46b8-adfe-33f73c732f77" containerName="istio-proxy" Jul 23 18:51:18.390381 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.390089 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c47a93a-11e0-4885-937a-f5abde30ee4a" containerName="istio-proxy" Jul 23 18:51:18.392996 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.392977 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.395815 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.395782 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w9xtf\"/\"default-dockercfg-8ktnr\"" Jul 23 18:51:18.396373 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.396352 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xtf\"/\"openshift-service-ca.crt\"" Jul 23 18:51:18.396952 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.396936 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w9xtf\"/\"kube-root-ca.crt\"" Jul 23 18:51:18.401676 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.401649 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv"] Jul 23 18:51:18.499012 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.498963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-proc\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.499208 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.499052 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-podres\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.499208 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.499088 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnk7l\" (UniqueName: \"kubernetes.io/projected/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-kube-api-access-cnk7l\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.499208 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.499106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-lib-modules\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.499208 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.499123 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-sys\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600411 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-lib-modules\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600411 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600416 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-sys\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600610 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600491 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-sys\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600610 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600535 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-proc\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600610 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600580 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-lib-modules\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600735 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-podres\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600735 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600621 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-proc\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600735 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnk7l\" (UniqueName: \"kubernetes.io/projected/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-kube-api-access-cnk7l\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.600735 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.600701 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-podres\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.611682 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.611652 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnk7l\" (UniqueName: \"kubernetes.io/projected/6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f-kube-api-access-cnk7l\") pod \"perf-node-gather-daemonset-85bdv\" (UID: \"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f\") " pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.703133 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.703038 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:18.835966 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:18.835940 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv"] Jul 23 18:51:18.838398 ip-10-0-134-130 kubenswrapper[2580]: W0723 18:51:18.838372 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a742d6e_cfb6_4ebc_b6e0_91b5efefea2f.slice/crio-cfffe3ae4fff7fb28852d0d79d206b5908d07a4c70206417b0bc063a4d086d57 WatchSource:0}: Error finding container cfffe3ae4fff7fb28852d0d79d206b5908d07a4c70206417b0bc063a4d086d57: Status 404 returned error can't find the container with id cfffe3ae4fff7fb28852d0d79d206b5908d07a4c70206417b0bc063a4d086d57 Jul 23 18:51:19.262232 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:19.262193 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-njhmd_524375a6-795e-4202-9bbb-72a23c296ffa/networking-console-plugin/0.log" Jul 23 18:51:19.381753 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:19.381721 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" event={"ID":"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f","Type":"ContainerStarted","Data":"2033e9fb572b1ff3034bb7f988fcfdc5fd96d2b046a105606d821cd10c6ad895"} Jul 23 18:51:19.381930 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:19.381768 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" event={"ID":"6a742d6e-cfb6-4ebc-b6e0-91b5efefea2f","Type":"ContainerStarted","Data":"cfffe3ae4fff7fb28852d0d79d206b5908d07a4c70206417b0bc063a4d086d57"} Jul 23 18:51:19.381930 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:19.381813 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:19.410070 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:19.410025 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" podStartSLOduration=1.410011868 podStartE2EDuration="1.410011868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:51:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:51:19.409276693 +0000 UTC m=+2937.649788376" watchObservedRunningTime="2026-07-23 18:51:19.410011868 +0000 UTC m=+2937.650523548" Jul 23 18:51:22.332909 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:22.332879 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppgk5_1cf1a438-fcad-4f8d-9800-5be27aab0e8f/dns/0.log" Jul 23 18:51:22.359840 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:22.359811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ppgk5_1cf1a438-fcad-4f8d-9800-5be27aab0e8f/kube-rbac-proxy/0.log" Jul 23 18:51:22.483518 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:22.483488 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h9w27_375bc743-21ff-4900-9b71-15c6aa813039/dns-node-resolver/0.log" Jul 23 18:51:23.210276 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:23.210249 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mllq9_5045a998-463e-4b12-90f1-6a4588f4d439/node-ca/0.log" Jul 23 18:51:24.275443 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:24.275405 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48lb89_5b4e9c4b-bef9-479a-88a6-5e1b28153445/istio-proxy/0.log" Jul 23 18:51:24.515148 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:24.515116 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6tl4_0b3ba082-91f8-4751-a8d6-bf413b6f8c95/discovery/0.log" Jul 23 18:51:25.395826 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:25.395803 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w9xtf/perf-node-gather-daemonset-85bdv" Jul 23 18:51:25.666223 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:25.666136 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-nmdrc_ff73e7ec-61ab-4bc2-94cf-fa1e568eeeff/serve-healthcheck-canary/0.log" Jul 23 18:51:26.272402 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:26.272351 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mrlv_a6001d54-1682-46ba-8d87-4d880b4ff470/kube-rbac-proxy/0.log" Jul 23 18:51:26.326389 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:26.326359 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mrlv_a6001d54-1682-46ba-8d87-4d880b4ff470/exporter/0.log" Jul 23 18:51:26.373811 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:26.373780 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7mrlv_a6001d54-1682-46ba-8d87-4d880b4ff470/extractor/0.log" Jul 23 18:51:28.187845 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:28.187815 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48lb89_5b4e9c4b-bef9-479a-88a6-5e1b28153445/istio-proxy/0.log" Jul 23 18:51:28.418251 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:28.418165 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6tl4_0b3ba082-91f8-4751-a8d6-bf413b6f8c95/discovery/0.log" Jul 23 18:51:29.836629 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:29.836600 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg_4eac455f-2366-478c-9019-53913c1300d4/manager/0.log" Jul 23 18:51:29.880150 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:29.880124 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-54dfb6bdcf-8wzmg_4eac455f-2366-478c-9019-53913c1300d4/copy-manifests/0.log" Jul 23 18:51:30.086016 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:30.085979 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf48lb89_5b4e9c4b-bef9-479a-88a6-5e1b28153445/istio-proxy/0.log" Jul 23 18:51:30.315209 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:30.315178 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-s6tl4_0b3ba082-91f8-4751-a8d6-bf413b6f8c95/discovery/0.log" Jul 23 18:51:31.739128 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:31.739102 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-689d89c9b7-4nvvv_58bd3c6b-7656-42fb-b489-c4677a9e3a3e/manager/0.log" Jul 23 18:51:37.097498 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:37.097469 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jtr5d_93c37885-cfc5-4cad-9f20-ae25b2e6176b/migrator/0.log" Jul 23 18:51:37.126949 ip-10-0-134-130 kubenswrapper[2580]: I0723 18:51:37.126921 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-jtr5d_93c37885-cfc5-4cad-9f20-ae25b2e6176b/graceful-termination/0.log"