Jul 17 17:49:25.504654 ip-10-0-138-33 systemd[1]: Starting Kubernetes Kubelet... Jul 17 17:49:25.922495 ip-10-0-138-33 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:49:25.922495 ip-10-0-138-33 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 17:49:25.922495 ip-10-0-138-33 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:49:25.922495 ip-10-0-138-33 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 17:49:25.922495 ip-10-0-138-33 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 17:49:25.923300 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.922580 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 17:49:25.927362 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927338 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:25.927362 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927363 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927369 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927373 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927376 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927380 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927382 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927385 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927388 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927391 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927394 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927404 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927407 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927410 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927412 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927415 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927418 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927420 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927423 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927426 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927429 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:25.927452 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927431 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927434 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927437 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927440 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927442 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927445 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927448 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927451 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927455 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927458 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927461 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927463 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927466 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927469 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927472 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927475 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927477 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927483 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927487 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:25.927946 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927490 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927493 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927496 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927498 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927501 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927503 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927506 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927508 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927511 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927513 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927516 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927518 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927523 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927526 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927529 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927533 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927536 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927539 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927542 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:25.928397 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927545 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927548 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927551 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927553 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927556 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927559 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927562 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927564 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927567 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927569 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927572 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927574 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927577 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927580 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927583 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927585 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927588 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927590 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927592 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:25.928877 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927595 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927597 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927601 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927603 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927606 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927608 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927611 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927613 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927616 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927619 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927622 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927624 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927626 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927629 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927631 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927634 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927636 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927639 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927641 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927644 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:25.929357 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.927647 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928446 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928455 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928458 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928461 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928464 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928468 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928471 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928474 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928476 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928479 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928482 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928484 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928487 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928489 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928493 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928495 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928498 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928500 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928503 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:25.929842 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928505 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928509 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928512 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928514 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928517 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928520 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928522 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928525 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928527 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928530 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928532 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928537 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928540 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928543 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928546 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928549 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928552 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928555 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928558 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:25.930502 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928563 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928567 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928570 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928573 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928576 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928578 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928581 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928585 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928587 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928590 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928593 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928595 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928597 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928600 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928603 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928605 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928608 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928620 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928622 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:25.930992 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928625 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928628 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928631 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928634 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928636 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928639 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928642 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928644 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928646 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928649 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928651 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928653 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928656 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928659 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928662 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928665 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928667 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928670 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928672 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928675 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:25.931474 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928678 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928681 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928685 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928687 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928690 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928694 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928697 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928701 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928704 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928707 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928709 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928712 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928714 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928717 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928719 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928722 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928724 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928727 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928730 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928732 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:25.931996 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928735 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.928737 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929221 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929227 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929231 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929233 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929237 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929240 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929242 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929245 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929247 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929251 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929253 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929256 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929259 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929262 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929265 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929267 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929270 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929273 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:25.932481 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929276 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929278 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929281 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929283 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929286 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929288 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929291 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929293 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929297 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929300 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929303 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929306 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929309 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929311 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929318 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929321 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929323 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929326 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929329 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:25.932994 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929333 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929337 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929341 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929344 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929348 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929350 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929353 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929356 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929358 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929361 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929364 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929369 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929372 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929375 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929378 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929381 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929383 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929386 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929388 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:25.933454 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929391 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929393 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929396 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929398 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929401 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929404 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929407 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929410 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929413 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929415 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929418 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929420 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929422 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929425 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929428 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929430 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929433 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929436 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929438 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:25.933928 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929441 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929443 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929446 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929448 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929450 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929453 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929455 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929457 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929460 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929463 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929465 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929467 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929470 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929473 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929475 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929478 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929481 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929483 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929486 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929488 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:25.934386 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929491 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929493 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929495 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.929498 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929580 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929592 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929602 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929609 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929616 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929622 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929626 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929631 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929634 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929637 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929641 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929645 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929648 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929652 2552 flags.go:64] FLAG: --cgroup-root="" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929655 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929658 2552 flags.go:64] FLAG: --client-ca-file="" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929661 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929664 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929669 2552 flags.go:64] FLAG: --cluster-domain="" Jul 17 17:49:25.934892 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929672 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929675 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929678 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929681 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929686 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929688 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929692 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929695 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929699 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929702 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929705 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929708 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929711 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929715 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929718 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929721 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929724 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929727 2552 flags.go:64] FLAG: --enable-server="true" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929730 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929735 2552 flags.go:64] FLAG: --event-burst="100" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929738 2552 flags.go:64] FLAG: --event-qps="50" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929741 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929744 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929747 2552 flags.go:64] FLAG: --eviction-hard="" Jul 17 17:49:25.935488 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929751 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929754 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929757 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929759 2552 flags.go:64] FLAG: --eviction-soft="" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929762 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929765 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929768 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929771 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929775 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929778 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929780 2552 flags.go:64] FLAG: --feature-gates="" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929784 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929787 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929790 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929793 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929796 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929799 2552 flags.go:64] FLAG: --help="false" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929802 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-138-33.ec2.internal" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929805 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929807 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929810 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929813 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929816 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929819 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 17:49:25.936117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929822 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929825 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929828 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929831 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929834 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929837 2552 flags.go:64] FLAG: --kube-reserved="" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929840 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929843 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929846 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929849 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929851 2552 flags.go:64] FLAG: --lock-file="" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929854 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929870 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929874 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929880 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929882 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929885 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929888 2552 flags.go:64] FLAG: --logging-format="text" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929891 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929897 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929900 2552 flags.go:64] FLAG: --manifest-url="" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929903 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929907 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929910 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929914 2552 flags.go:64] FLAG: --max-pods="110" Jul 17 17:49:25.936727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929917 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929920 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929923 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929926 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929929 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929931 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929934 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929942 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929945 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929953 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929956 2552 flags.go:64] FLAG: --pod-cidr="" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929960 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929966 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929969 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929972 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929975 2552 flags.go:64] FLAG: --port="10250" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929978 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929981 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00458873a6dbf1fd7" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929984 2552 flags.go:64] FLAG: --qos-reserved="" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929987 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929990 2552 flags.go:64] FLAG: --register-node="true" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929993 2552 flags.go:64] FLAG: --register-with-taints="" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929997 2552 flags.go:64] FLAG: --registry-burst="10" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.929999 2552 flags.go:64] FLAG: --registry-qps="5" Jul 17 17:49:25.937367 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930002 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930005 2552 flags.go:64] FLAG: --reserved-memory="" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930009 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930013 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930016 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930019 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930022 2552 flags.go:64] FLAG: --runonce="false" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930024 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930027 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930030 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930033 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930036 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930039 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930042 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930045 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930048 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930051 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930055 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930057 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930060 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930064 2552 flags.go:64] FLAG: --system-cgroups="" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930067 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930072 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930075 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930078 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 17:49:25.937982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930083 2552 flags.go:64] FLAG: --tls-min-version="" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930085 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930088 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930091 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930094 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930097 2552 flags.go:64] FLAG: --v="2" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930101 2552 flags.go:64] FLAG: --version="false" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930105 2552 flags.go:64] FLAG: --vmodule="" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930108 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.930111 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930238 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930242 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930245 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930248 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930250 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930253 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930256 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930259 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930261 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930264 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930266 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930269 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:25.938597 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930272 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930275 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930278 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930281 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930284 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930287 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930290 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930293 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930295 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930299 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930303 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930306 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930309 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930312 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930314 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930317 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930320 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930322 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930325 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:25.939196 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930327 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930331 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930334 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930336 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930339 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930342 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930345 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930347 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930350 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930352 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930355 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930358 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930360 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930363 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930365 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930369 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930372 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930374 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930377 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930379 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:25.939690 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930382 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930385 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930388 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930391 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930395 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930398 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930401 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930404 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930407 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930409 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930412 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930414 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930417 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930422 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930425 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930427 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930430 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930432 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930435 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:25.940258 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930438 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930440 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930442 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930445 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930447 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930450 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930452 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930455 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930459 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930462 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930465 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930467 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930470 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930472 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930479 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930482 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930484 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930487 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930489 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930492 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:25.940722 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930494 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930497 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930499 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930502 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930504 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930509 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930514 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930517 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.930520 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.931451 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.938783 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.938804 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.938819 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.938825 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 17:49:25.941243 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938908 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938915 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938919 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938922 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938926 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938929 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938932 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938935 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938939 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938942 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938945 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938947 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938955 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938958 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938961 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938963 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938966 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938969 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938971 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938974 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:25.941738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938976 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938979 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938982 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938984 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938987 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938989 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.938992 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939007 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939012 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939015 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939019 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939021 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939024 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939026 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939029 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939031 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939034 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939036 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939039 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939041 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:25.942482 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939044 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939047 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939049 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939051 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939054 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939058 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939060 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939063 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939065 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939067 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939070 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939073 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939075 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939078 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939081 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939083 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939085 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939088 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939090 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939093 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:25.943049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939096 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939099 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939103 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939105 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939108 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939110 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939114 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939118 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939121 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939124 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939126 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939129 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939132 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939134 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939137 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939140 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939142 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939145 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939148 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:25.943553 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939151 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939155 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939159 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939162 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939165 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939167 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939170 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939172 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939176 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939178 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939181 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939184 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939186 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939189 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939192 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939195 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939198 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939201 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939203 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:25.944025 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939206 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.939212 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939334 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939339 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939343 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939347 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939350 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939352 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939355 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939358 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939361 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939364 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939367 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939370 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 17:49:25.944500 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939373 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939376 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939379 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939381 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939384 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939386 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939389 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939391 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939394 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939396 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939399 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939401 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939403 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939407 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939409 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939412 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939414 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939417 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939419 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939421 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 17:49:25.944848 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939424 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939426 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939429 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939431 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939434 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939436 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939438 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939441 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939443 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939445 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939449 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939451 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939454 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939457 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939459 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939462 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939464 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939467 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939469 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939471 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 17:49:25.945356 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939475 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939479 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939482 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939485 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939488 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939490 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939493 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939496 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939498 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939501 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939504 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939506 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939508 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939512 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939515 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939518 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939521 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939523 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939526 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 17:49:25.945840 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939528 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939531 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939534 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939537 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939539 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939542 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939545 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939547 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939550 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939552 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939555 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939557 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939560 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939562 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939565 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939567 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939569 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939572 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939575 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939577 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 17:49:25.946317 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939580 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939582 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939586 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939588 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939591 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939593 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939595 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:25.939598 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.939603 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.939739 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.943012 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.944437 2552 server.go:1019] "Starting client certificate rotation" Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.944550 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:49:25.946797 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.945216 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 17:49:25.947669 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.947652 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:49:25.951601 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.951582 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 17:49:25.961194 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.961171 2552 log.go:25] "Validated CRI v1 runtime API" Jul 17 17:49:25.963486 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.963467 2552 log.go:25] "Validated CRI v1 image API" Jul 17 17:49:25.965054 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.965020 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 17:49:25.969710 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.969687 2552 fs.go:135] Filesystem UUIDs: map[3e43bf54-6c0f-4737-96d2-da74795ebfc9:/dev/nvme0n1p4 6798e646-5ce7-4470-a9f8-b8c9b9c766a5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 17 17:49:25.969792 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.969709 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 17:49:25.973746 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.973719 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:49:25.976040 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.975919 2552 manager.go:216] Machine: {Timestamp:2026-07-17 17:49:25.973818993 +0000 UTC m=+0.328670568 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097549 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a4049f1a75a1f8cb70895adfc58f6 SystemUUID:ec2a4049-f1a7-5a1f-8cb7-0895adfc58f6 BootID:012d5423-c155-4fed-b0e5-aa7b661abe19 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c1:15:bb:ea:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c1:15:bb:ea:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:b5:c9:be:55:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 17:49:25.976040 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.976037 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 17:49:25.976212 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.976196 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 17:49:25.979198 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.979159 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 17:49:25.979358 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.979205 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 17:49:25.979895 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.979885 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 17:49:25.979927 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.979899 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 17:49:25.979927 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.979906 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:49:25.980669 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.980657 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 17:49:25.981873 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.981847 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 17:49:25.984618 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.984604 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:49:25.984761 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.984751 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 17:49:25.984802 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.984794 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 17 17:49:25.984832 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.984814 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 17:49:25.984832 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.984829 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 17:49:25.984913 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.984840 2552 kubelet.go:398] "Adding apiserver pod source" Jul 17 17:49:25.984913 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.984849 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 17:49:25.985508 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.985487 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:49:25.985627 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.985520 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 17:49:25.988018 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.987999 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 17:49:25.989913 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.989898 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 17:49:25.989986 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.989929 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 17:49:25.991021 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.990993 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 17:49:25.991097 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991049 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 17:49:25.991097 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991057 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 17:49:25.991097 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991073 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 17:49:25.991097 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991082 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 17:49:25.991097 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991088 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 17:49:25.991097 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991096 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 17:49:25.991277 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991101 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 17:49:25.991277 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991108 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 17:49:25.991277 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991113 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 17:49:25.991277 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991129 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 17:49:25.991277 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.991134 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 17:49:25.993051 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.993022 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 17:49:25.993051 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.993056 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 17:49:25.998030 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.997996 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cbxpd" Jul 17 17:49:25.998549 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.998532 2552 server.go:1268] "Started kubelet" Jul 17 17:49:25.998659 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.998626 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 17:49:25.998803 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.998760 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 17:49:25.998934 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:25.998823 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 17:49:25.999713 ip-10-0-138-33 systemd[1]: Started Kubernetes Kubelet. Jul 17 17:49:26.000449 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.000124 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 17:49:26.000449 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.000139 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 17:49:26.000449 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.000190 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 17:49:26.000627 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.000463 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 17:49:26.000961 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.000945 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 17 17:49:26.004533 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.003389 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-33.ec2.internal.18c325018f50ee1a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-33.ec2.internal,UID:ip-10-0-138-33.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-33.ec2.internal,},FirstTimestamp:2026-07-17 17:49:25.998489114 +0000 UTC m=+0.353340685,LastTimestamp:2026-07-17 17:49:25.998489114 +0000 UTC m=+0.353340685,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-33.ec2.internal,}" Jul 17 17:49:26.004925 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.004909 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cbxpd" Jul 17 17:49:26.005995 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.005975 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 17:49:26.007996 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.007974 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 17:49:26.008084 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.007976 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 17:49:26.008154 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.008069 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.008606 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.008590 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 17:49:26.008700 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.008592 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 17:49:26.008776 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.008768 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 17:49:26.008959 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.008939 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 17 17:49:26.008959 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.008956 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 17 17:49:26.009566 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.009551 2552 factory.go:55] Registering systemd factory Jul 17 17:49:26.009566 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.009567 2552 factory.go:223] Registration of the systemd container factory successfully Jul 17 17:49:26.009821 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.009806 2552 factory.go:153] Registering CRI-O factory Jul 17 17:49:26.009896 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.009824 2552 factory.go:223] Registration of the crio container factory successfully Jul 17 17:49:26.009948 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.009898 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 17:49:26.009948 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.009925 2552 factory.go:103] Registering Raw factory Jul 17 17:49:26.009948 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.009941 2552 manager.go:1196] Started watching for new ooms in manager Jul 17 17:49:26.010305 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.010291 2552 manager.go:349] Starting recovery of all containers Jul 17 17:49:26.014492 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.014464 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:26.017951 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.017924 2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.024829 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.024809 2552 manager.go:354] Recovery completed Jul 17 17:49:26.029221 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.029205 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:26.031264 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.031244 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:26.031373 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.031275 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:26.031373 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.031287 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:26.031823 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.031808 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 17:49:26.031823 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.031820 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 17:49:26.031960 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.031829 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:26.031960 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.031837 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 17 17:49:26.032529 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.032516 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:26.032581 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.032540 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:26.032581 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.032550 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:26.033253 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.033241 2552 policy_none.go:49] "None policy: Start" Jul 17 17:49:26.033286 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.033264 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 17:49:26.033286 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.033275 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 17:49:26.034535 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.034525 2552 policy_none.go:47] "Start" Jul 17 17:49:26.063760 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.063577 2552 manager.go:337] "Starting Device Plugin manager" Jul 17 17:49:26.063910 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.063774 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 17:49:26.063910 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.063788 2552 server.go:87] "Starting device plugin registration server" Jul 17 17:49:26.064115 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.064101 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 17:49:26.064171 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.064117 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 17:49:26.064284 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.064231 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 17:49:26.064646 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.064423 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 17:49:26.064646 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.064438 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 17:49:26.064953 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.064934 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 17:49:26.065036 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.064994 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.119016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.118976 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 17:49:26.120400 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.120381 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 17:49:26.120478 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.120423 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 17:49:26.120478 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.120465 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 17:49:26.120580 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.120499 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 17:49:26.123344 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.123324 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:26.164979 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.164945 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:26.166010 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.165992 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:26.166099 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.166023 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:26.166099 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.166034 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:26.166099 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.166059 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.171653 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.171636 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.171713 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.171663 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-33.ec2.internal\": node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.185749 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.185673 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.221109 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.221074 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal"] Jul 17 17:49:26.221191 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.221171 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:26.222248 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.222220 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:26.222387 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.222260 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:26.222387 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.222275 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:26.223557 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.223542 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:26.223689 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.223658 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.223747 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.223697 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:26.224375 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.224357 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:26.224461 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.224385 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:26.224461 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.224396 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:26.224461 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.224365 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:26.224461 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.224453 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:26.224601 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.224468 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:26.225675 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.225658 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.225763 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.225685 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 17:49:26.229203 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.229182 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jul 17 17:49:26.229316 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.229218 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 17:49:26.229316 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.229232 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jul 17 17:49:26.258630 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.258605 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.263497 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.263479 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.285781 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.285749 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.310365 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.310337 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.310463 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.310371 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.310463 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.310397 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31783b4ed77dfc64030a66f386750024-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"31783b4ed77dfc64030a66f386750024\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.386608 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.386564 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.411131 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.411100 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.411234 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.411140 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.411234 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.411166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31783b4ed77dfc64030a66f386750024-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"31783b4ed77dfc64030a66f386750024\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.411234 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.411183 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.411234 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.411196 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/31783b4ed77dfc64030a66f386750024-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"31783b4ed77dfc64030a66f386750024\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.411371 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.411250 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c6d814b9e1fe3f97302765f12ed4851-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"0c6d814b9e1fe3f97302765f12ed4851\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.487579 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.487491 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.562071 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.562046 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.566938 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.566918 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 17 17:49:26.588112 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.588073 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.688642 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.688599 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.789120 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.789088 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.846842 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.846811 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:26.889266 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.889229 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:26.943828 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.943787 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 17:49:26.944322 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.943956 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:49:26.944322 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.943993 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:49:26.944322 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:26.944000 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 17:49:26.990357 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:26.990321 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.008620 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.008592 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 17:44:26 +0000 UTC" deadline="2028-01-12 06:58:50.62710342 +0000 UTC" Jul 17 17:49:27.008620 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.008619 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13045h9m23.61848772s" Jul 17 17:49:27.090839 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.090767 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.103958 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:27.103921 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31783b4ed77dfc64030a66f386750024.slice/crio-effb3558d6e32bba5ef830b11e225b3e15b13cecd92d52b70cc4b6782ec53390 WatchSource:0}: Error finding container effb3558d6e32bba5ef830b11e225b3e15b13cecd92d52b70cc4b6782ec53390: Status 404 returned error can't find the container with id effb3558d6e32bba5ef830b11e225b3e15b13cecd92d52b70cc4b6782ec53390 Jul 17 17:49:27.104134 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:27.104120 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c6d814b9e1fe3f97302765f12ed4851.slice/crio-5013c60a1a1f54a98c9b3dd8e699656bc05bdb6d0313ecd5223b91ac1928e2ed WatchSource:0}: Error finding container 5013c60a1a1f54a98c9b3dd8e699656bc05bdb6d0313ecd5223b91ac1928e2ed: Status 404 returned error can't find the container with id 5013c60a1a1f54a98c9b3dd8e699656bc05bdb6d0313ecd5223b91ac1928e2ed Jul 17 17:49:27.109548 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.109531 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:49:27.126672 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.126620 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" event={"ID":"31783b4ed77dfc64030a66f386750024","Type":"ContainerStarted","Data":"effb3558d6e32bba5ef830b11e225b3e15b13cecd92d52b70cc4b6782ec53390"} Jul 17 17:49:27.127714 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.127688 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"0c6d814b9e1fe3f97302765f12ed4851","Type":"ContainerStarted","Data":"5013c60a1a1f54a98c9b3dd8e699656bc05bdb6d0313ecd5223b91ac1928e2ed"} Jul 17 17:49:27.191937 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.191888 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.292426 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.292388 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.393046 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.392969 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.493843 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.493803 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.594315 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.594285 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.694943 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.694837 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.795456 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.795415 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.881003 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.880969 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:27.896453 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.896410 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jul 17 17:49:27.948035 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.947948 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:27.985457 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.985417 2552 apiserver.go:52] "Watching apiserver" Jul 17 17:49:27.995271 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.995236 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 17:49:27.995650 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.995619 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-z6h6q","openshift-network-operator/iptables-alerter-h5dnv","kube-system/global-pull-secret-syncer-5vt46","openshift-multus/multus-additional-cni-plugins-52tzf","openshift-multus/multus-f698w","openshift-ovn-kubernetes/ovnkube-node-btzx5","kube-system/konnectivity-agent-vqpx4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc","openshift-cluster-node-tuning-operator/tuned-6w6br","openshift-dns/node-resolver-7zggz","openshift-image-registry/node-ca-q68qj","openshift-multus/network-metrics-daemon-krdns"] Jul 17 17:49:27.997519 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.997492 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:27.997649 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:27.997579 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:27.999390 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:27.999370 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.001263 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.001242 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.001363 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.001317 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:28.002193 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.002167 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:28.002295 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.002177 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:28.002295 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.002229 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dbjcz\"" Jul 17 17:49:28.002391 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.002295 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 17:49:28.003619 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.002977 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.004629 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.004609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f698w" Jul 17 17:49:28.005940 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.005917 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 17:49:28.006091 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.006068 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mlfbk\"" Jul 17 17:49:28.006611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.006445 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 17:49:28.006611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.006464 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 17:49:28.006611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.006501 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 17:49:28.006611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.006465 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 17:49:28.006798 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.006752 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.007142 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.007124 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8gjdw\"" Jul 17 17:49:28.007643 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.007360 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 17:49:28.008590 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.008575 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 17:49:28.009118 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.008959 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.009118 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.008966 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jul 17 17:49:28.009530 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.009511 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 17:49:28.009699 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.009678 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bpsq4\"" Jul 17 17:49:28.009808 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.009770 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 17:49:28.009886 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.009808 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 17:49:28.009886 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.009877 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 17:49:28.010216 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.010202 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 17:49:28.010955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.010936 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.011524 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.011507 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-h5hft\"" Jul 17 17:49:28.011613 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.011540 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 17:49:28.011659 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.011631 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 17:49:28.012035 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.011995 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 17:49:28.013010 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.012987 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.014428 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.014401 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 17:49:28.015403 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.014986 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 17:49:28.015586 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.015522 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 17:49:28.017457 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.015691 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m7vzb\"" Jul 17 17:49:28.017457 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.016056 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 17:49:28.017457 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.016177 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 17:49:28.017457 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.016396 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gqkb2\"" Jul 17 17:49:28.017457 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.016436 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.019188 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.019165 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bqlnf\"" Jul 17 17:49:28.019398 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.019379 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 17:49:28.019591 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.019577 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 17:49:28.019771 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.019751 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.020052 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020015 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.020144 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020056 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-socket-dir-parent\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.020144 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020082 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020144 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-env-overrides\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020144 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020129 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovnkube-script-lib\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020159 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-socket-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.020333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020198 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-system-cni-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.020333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020247 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-node-log\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020279 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.020333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020322 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b10f06a8-9d82-4270-bc05-d6654c98e6c0-iptables-alerter-script\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.020525 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020354 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d7a696b-d2cb-435a-b96f-d4689a611561-cni-binary-copy\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.020525 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020390 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-ovn\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020525 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-os-release\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.020525 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020461 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-multus-certs\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.020525 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-kubelet\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020722 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020541 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020722 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020590 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-cni-netd\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020722 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020625 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.020722 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.020722 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020678 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-systemd-units\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020722 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020703 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-run-netns\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020971 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020740 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-etc-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020971 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020792 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-log-socket\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.020971 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020822 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b10f06a8-9d82-4270-bc05-d6654c98e6c0-host-slash\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.020971 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020854 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-conf-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021129 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.020994 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-etc-kubernetes\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021129 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021040 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.021129 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021068 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-k8s-cni-cncf-io\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021129 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-systemd\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.021293 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:28.021293 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021174 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-sys-fs\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.021293 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021198 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdlzg\" (UniqueName: \"kubernetes.io/projected/b10f06a8-9d82-4270-bc05-d6654c98e6c0-kube-api-access-mdlzg\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.021293 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021221 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-netns\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021293 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021245 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:49:28.021498 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021322 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8j68\" (UniqueName: \"kubernetes.io/projected/fa2a4f21-25e1-4274-b43b-e1dc56f97250-kube-api-access-w8j68\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.021498 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021341 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jul 17 17:49:28.021498 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021350 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cnibin\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.021498 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021389 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.021498 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021428 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-cni-multus\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021498 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021453 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-daemon-config\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021498 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021478 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wg5r\" (UniqueName: \"kubernetes.io/projected/9d7a696b-d2cb-435a-b96f-d4689a611561-kube-api-access-8wg5r\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021506 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-var-lib-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021562 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/293c10fa-e12e-4eae-a937-5a2f26cac6d7-dbus\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021586 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/293c10fa-e12e-4eae-a937-5a2f26cac6d7-kubelet-config\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021609 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-hostroot\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovnkube-config\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021657 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovn-node-metrics-cert\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021697 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021723 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-os-release\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.021758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021757 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-cnibin\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.022141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021916 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-cni-bin\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.022141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9tl6\" (UniqueName: \"kubernetes.io/projected/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-kube-api-access-l9tl6\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.022141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.021989 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-registration-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.022141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022015 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-device-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.022141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022052 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-system-cni-dir\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.022141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.022141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022126 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-kubelet\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.022407 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022240 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk69l\" (UniqueName: \"kubernetes.io/projected/b9d79024-5b82-4116-9f69-d76f36c7b0ee-kube-api-access-mk69l\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.022407 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022275 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal"] Jul 17 17:49:28.022407 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022280 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-cni-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.022407 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022378 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:28.022407 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022390 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 17:49:28.022608 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.022433 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:28.022608 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022460 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-slash\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.022608 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022517 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-cni-bin\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.022608 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022543 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82b9c982-255e-4782-b917-85ccca03653e-agent-certs\") pod \"konnectivity-agent-vqpx4\" (UID: \"82b9c982-255e-4782-b917-85ccca03653e\") " pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.022608 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022574 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c982-255e-4782-b917-85ccca03653e-konnectivity-ca\") pod \"konnectivity-agent-vqpx4\" (UID: \"82b9c982-255e-4782-b917-85ccca03653e\") " pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.022879 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022685 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 17:49:28.022879 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022705 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kpf9p\"" Jul 17 17:49:28.022879 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.022734 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 17:49:28.023277 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.023258 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 17:49:28.030328 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.030301 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 17:49:28.030533 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.030514 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal"] Jul 17 17:49:28.045645 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.045622 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rccsd" Jul 17 17:49:28.053981 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.053672 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rccsd" Jul 17 17:49:28.109886 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.109849 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 17:49:28.111389 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.111361 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:28.124172 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124127 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-system-cni-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.124348 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124182 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-node-log\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.124348 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124221 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.124348 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124255 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06bdc7aa-4d36-49db-81a2-fc4752b6629c-tmp\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.124348 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124277 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b10f06a8-9d82-4270-bc05-d6654c98e6c0-iptables-alerter-script\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.124348 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124296 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d7a696b-d2cb-435a-b96f-d4689a611561-cni-binary-copy\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.124348 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124326 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-ovn\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124347 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbzk\" (UniqueName: \"kubernetes.io/projected/80645c97-ff4e-44d9-aaf6-60443de654fb-kube-api-access-pxbzk\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124433 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-host\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124456 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-os-release\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124502 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-multus-certs\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124519 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-kubelet\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124564 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124592 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-cni-netd\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.124652 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124617 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8ljd\" (UniqueName: \"kubernetes.io/projected/b3309a02-8972-48d1-9a5e-444ca7372c65-kube-api-access-b8ljd\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124706 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124737 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-systemd-units\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124763 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-run-netns\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124794 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-etc-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124856 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-log-socket\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124884 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-lib-modules\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125016 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.124935 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3309a02-8972-48d1-9a5e-444ca7372c65-tmp-dir\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125048 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b10f06a8-9d82-4270-bc05-d6654c98e6c0-host-slash\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125070 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-conf-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125086 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-etc-kubernetes\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wwd\" (UniqueName: \"kubernetes.io/projected/f5954494-0d8d-49e0-83bd-c538159c1142-kube-api-access-m4wwd\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-k8s-cni-cncf-io\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125229 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-systemd\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125244 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-systemd\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3309a02-8972-48d1-9a5e-444ca7372c65-hosts-file\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125294 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125313 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-sys-fs\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.125366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125340 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysconfig\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125373 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysctl-d\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125408 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-sys\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125429 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-tuned\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125453 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdlzg\" (UniqueName: \"kubernetes.io/projected/b10f06a8-9d82-4270-bc05-d6654c98e6c0-kube-api-access-mdlzg\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-netns\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125562 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8j68\" (UniqueName: \"kubernetes.io/projected/fa2a4f21-25e1-4274-b43b-e1dc56f97250-kube-api-access-w8j68\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125582 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cnibin\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125613 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125640 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-cni-multus\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125657 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-daemon-config\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125684 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wg5r\" (UniqueName: \"kubernetes.io/projected/9d7a696b-d2cb-435a-b96f-d4689a611561-kube-api-access-8wg5r\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125728 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-var-lib-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125748 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-modprobe-d\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125784 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/293c10fa-e12e-4eae-a937-5a2f26cac6d7-dbus\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125800 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysctl-conf\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125828 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/293c10fa-e12e-4eae-a937-5a2f26cac6d7-kubelet-config\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.125929 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125847 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-hostroot\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125909 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovnkube-config\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125954 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovn-node-metrics-cert\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.125972 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-kubernetes\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126040 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126088 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-node-log\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126083 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126172 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-os-release\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126209 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126295 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-var-lib-kubelet\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126435 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-k8s-cni-cncf-io\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.126725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126483 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-systemd\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.127313 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126795 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b10f06a8-9d82-4270-bc05-d6654c98e6c0-iptables-alerter-script\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.127313 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126844 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-sys-fs\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.127313 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126853 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-cnibin\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.127313 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.126929 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-cni-bin\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.127583 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.127559 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.127812 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.127787 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-netns\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.127812 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.127798 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-var-lib-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.127955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.127864 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-cni-bin\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.128307 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128283 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 17:49:28.128399 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128362 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-etc-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.128452 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128428 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/293c10fa-e12e-4eae-a937-5a2f26cac6d7-kubelet-config\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.128500 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128428 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.128573 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128525 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-systemd-units\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.128625 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128593 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/293c10fa-e12e-4eae-a937-5a2f26cac6d7-dbus\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.128674 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128629 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-cni-multus\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.128723 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128674 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-ovn\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.128723 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128712 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cnibin\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.128888 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128863 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-hostroot\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.128967 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128888 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-os-release\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.128967 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128955 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-run-multus-certs\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.128967 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128956 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-run-openvswitch\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.129113 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129030 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-system-cni-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.129113 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129057 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovnkube-config\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.129208 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129153 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-etc-kubernetes\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.129208 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129197 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d7a696b-d2cb-435a-b96f-d4689a611561-cni-binary-copy\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.129308 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129202 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-cnibin\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.129308 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129230 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b10f06a8-9d82-4270-bc05-d6654c98e6c0-host-slash\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.129308 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129297 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-os-release\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.129444 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129308 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-conf-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.129731 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129710 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-log-socket\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.129787 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129770 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.129787 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129778 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9tl6\" (UniqueName: \"kubernetes.io/projected/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-kube-api-access-l9tl6\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.129883 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129815 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-kubelet\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.129883 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129818 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-registration-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.129883 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.128294 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-run-netns\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.129883 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129855 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9d79024-5b82-4116-9f69-d76f36c7b0ee-cni-binary-copy\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.130080 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129934 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-device-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.130080 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.129979 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80645c97-ff4e-44d9-aaf6-60443de654fb-serviceca\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.130080 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130012 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhq8\" (UniqueName: \"kubernetes.io/projected/06bdc7aa-4d36-49db-81a2-fc4752b6629c-kube-api-access-kdhq8\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.130282 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130050 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-daemon-config\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.130282 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130126 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-cni-netd\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.130282 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130149 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-registration-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.130282 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-system-cni-dir\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.130282 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130211 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.130282 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130233 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-device-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.130282 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130270 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-kubelet\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130330 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-system-cni-dir\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130336 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-host-var-lib-kubelet\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130364 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-run\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk69l\" (UniqueName: \"kubernetes.io/projected/b9d79024-5b82-4116-9f69-d76f36c7b0ee-kube-api-access-mk69l\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130443 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-cni-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-slash\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130544 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9d79024-5b82-4116-9f69-d76f36c7b0ee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130561 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-cni-dir\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130572 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-cni-bin\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.130611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130608 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82b9c982-255e-4782-b917-85ccca03653e-agent-certs\") pod \"konnectivity-agent-vqpx4\" (UID: \"82b9c982-255e-4782-b917-85ccca03653e\") " pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c982-255e-4782-b917-85ccca03653e-konnectivity-ca\") pod \"konnectivity-agent-vqpx4\" (UID: \"82b9c982-255e-4782-b917-85ccca03653e\") " pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130608 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-slash\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130692 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130732 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-socket-dir-parent\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130743 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-cni-bin\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130770 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.130842 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9d7a696b-d2cb-435a-b96f-d4689a611561-multus-socket-dir-parent\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.131035 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:28.131104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131094 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.131480 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.131158 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret podName:293c10fa-e12e-4eae-a937-5a2f26cac6d7 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:28.631097724 +0000 UTC m=+2.985949296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret") pod "global-pull-secret-syncer-5vt46" (UID: "293c10fa-e12e-4eae-a937-5a2f26cac6d7") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:28.131480 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131349 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/82b9c982-255e-4782-b917-85ccca03653e-konnectivity-ca\") pod \"konnectivity-agent-vqpx4\" (UID: \"82b9c982-255e-4782-b917-85ccca03653e\") " pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.131480 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131400 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-env-overrides\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.131480 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131423 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovnkube-script-lib\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.131480 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131443 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-socket-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.131480 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131464 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80645c97-ff4e-44d9-aaf6-60443de654fb-host\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.131780 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131683 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fa2a4f21-25e1-4274-b43b-e1dc56f97250-socket-dir\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.132321 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.131968 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-env-overrides\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.132321 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.132115 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovnkube-script-lib\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.132705 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.132670 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:28.132795 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.132731 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:28.132795 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.132752 2552 projected.go:196] Error preparing data for projected volume kube-api-access-ql2nx for pod openshift-network-diagnostics/network-check-target-z6h6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:28.132795 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.132783 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-ovn-node-metrics-cert\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.133029 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.132823 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx podName:6f7d9efa-2c21-4519-a32e-61cd3eb09f3d nodeName:}" failed. No retries permitted until 2026-07-17 17:49:28.632807396 +0000 UTC m=+2.987658969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ql2nx" (UniqueName: "kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx") pod "network-check-target-z6h6q" (UID: "6f7d9efa-2c21-4519-a32e-61cd3eb09f3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:28.134342 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.134320 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/82b9c982-255e-4782-b917-85ccca03653e-agent-certs\") pod \"konnectivity-agent-vqpx4\" (UID: \"82b9c982-255e-4782-b917-85ccca03653e\") " pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.137624 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.137592 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdlzg\" (UniqueName: \"kubernetes.io/projected/b10f06a8-9d82-4270-bc05-d6654c98e6c0-kube-api-access-mdlzg\") pod \"iptables-alerter-h5dnv\" (UID: \"b10f06a8-9d82-4270-bc05-d6654c98e6c0\") " pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.138173 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.138036 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wg5r\" (UniqueName: \"kubernetes.io/projected/9d7a696b-d2cb-435a-b96f-d4689a611561-kube-api-access-8wg5r\") pod \"multus-f698w\" (UID: \"9d7a696b-d2cb-435a-b96f-d4689a611561\") " pod="openshift-multus/multus-f698w" Jul 17 17:49:28.138731 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.138710 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9tl6\" (UniqueName: \"kubernetes.io/projected/6382d403-d5f4-41ab-b0e6-2087ebf9d4a4-kube-api-access-l9tl6\") pod \"ovnkube-node-btzx5\" (UID: \"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.138824 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.138734 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8j68\" (UniqueName: \"kubernetes.io/projected/fa2a4f21-25e1-4274-b43b-e1dc56f97250-kube-api-access-w8j68\") pod \"aws-ebs-csi-driver-node-xqkvc\" (UID: \"fa2a4f21-25e1-4274-b43b-e1dc56f97250\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.140164 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.140143 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk69l\" (UniqueName: \"kubernetes.io/projected/b9d79024-5b82-4116-9f69-d76f36c7b0ee-kube-api-access-mk69l\") pod \"multus-additional-cni-plugins-52tzf\" (UID: \"b9d79024-5b82-4116-9f69-d76f36c7b0ee\") " pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.232853 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232767 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-systemd\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.232853 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232815 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3309a02-8972-48d1-9a5e-444ca7372c65-hosts-file\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232886 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysconfig\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysctl-d\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232929 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-systemd\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232956 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysconfig\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232973 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3309a02-8972-48d1-9a5e-444ca7372c65-hosts-file\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232995 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-sys\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.232938 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-sys\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233035 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-tuned\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233066 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-modprobe-d\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysctl-conf\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233065 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysctl-d\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233139 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-kubernetes\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233167 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233197 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-var-lib-kubelet\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233210 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-kubernetes\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233233 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-sysctl-conf\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233227 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80645c97-ff4e-44d9-aaf6-60443de654fb-serviceca\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233265 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-modprobe-d\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.233304 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233331 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhq8\" (UniqueName: \"kubernetes.io/projected/06bdc7aa-4d36-49db-81a2-fc4752b6629c-kube-api-access-kdhq8\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233303 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-var-lib-kubelet\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-run\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.233395 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs podName:f5954494-0d8d-49e0-83bd-c538159c1142 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:28.733374139 +0000 UTC m=+3.088225705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs") pod "network-metrics-daemon-krdns" (UID: "f5954494-0d8d-49e0-83bd-c538159c1142") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233429 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-run\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233448 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80645c97-ff4e-44d9-aaf6-60443de654fb-host\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233484 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06bdc7aa-4d36-49db-81a2-fc4752b6629c-tmp\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233486 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80645c97-ff4e-44d9-aaf6-60443de654fb-host\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233514 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbzk\" (UniqueName: \"kubernetes.io/projected/80645c97-ff4e-44d9-aaf6-60443de654fb-kube-api-access-pxbzk\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.233640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233542 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-host\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233598 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8ljd\" (UniqueName: \"kubernetes.io/projected/b3309a02-8972-48d1-9a5e-444ca7372c65-kube-api-access-b8ljd\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233629 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-lib-modules\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233623 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-host\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233654 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3309a02-8972-48d1-9a5e-444ca7372c65-tmp-dir\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233702 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80645c97-ff4e-44d9-aaf6-60443de654fb-serviceca\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233706 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wwd\" (UniqueName: \"kubernetes.io/projected/f5954494-0d8d-49e0-83bd-c538159c1142-kube-api-access-m4wwd\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233826 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/06bdc7aa-4d36-49db-81a2-fc4752b6629c-lib-modules\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.234436 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.233963 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3309a02-8972-48d1-9a5e-444ca7372c65-tmp-dir\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.235694 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.235672 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/06bdc7aa-4d36-49db-81a2-fc4752b6629c-etc-tuned\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.235842 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.235824 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06bdc7aa-4d36-49db-81a2-fc4752b6629c-tmp\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.245036 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.244968 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8ljd\" (UniqueName: \"kubernetes.io/projected/b3309a02-8972-48d1-9a5e-444ca7372c65-kube-api-access-b8ljd\") pod \"node-resolver-7zggz\" (UID: \"b3309a02-8972-48d1-9a5e-444ca7372c65\") " pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.247423 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.247394 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhq8\" (UniqueName: \"kubernetes.io/projected/06bdc7aa-4d36-49db-81a2-fc4752b6629c-kube-api-access-kdhq8\") pod \"tuned-6w6br\" (UID: \"06bdc7aa-4d36-49db-81a2-fc4752b6629c\") " pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.247958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.247930 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbzk\" (UniqueName: \"kubernetes.io/projected/80645c97-ff4e-44d9-aaf6-60443de654fb-kube-api-access-pxbzk\") pod \"node-ca-q68qj\" (UID: \"80645c97-ff4e-44d9-aaf6-60443de654fb\") " pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.247958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.247943 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wwd\" (UniqueName: \"kubernetes.io/projected/f5954494-0d8d-49e0-83bd-c538159c1142-kube-api-access-m4wwd\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:28.316374 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.316332 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h5dnv" Jul 17 17:49:28.324707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.324681 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-52tzf" Jul 17 17:49:28.331528 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.331507 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f698w" Jul 17 17:49:28.337522 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.337500 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:28.344409 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.344381 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:28.351366 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.351343 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" Jul 17 17:49:28.358247 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.358227 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6w6br" Jul 17 17:49:28.365109 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.365082 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7zggz" Jul 17 17:49:28.371146 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.371128 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q68qj" Jul 17 17:49:28.636374 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.636338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:28.636546 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.636396 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:28.636546 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.636532 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:28.636645 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.636546 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:28.636645 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.636564 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:28.636645 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.636576 2552 projected.go:196] Error preparing data for projected volume kube-api-access-ql2nx for pod openshift-network-diagnostics/network-check-target-z6h6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:28.636645 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.636612 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret podName:293c10fa-e12e-4eae-a937-5a2f26cac6d7 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:29.636593105 +0000 UTC m=+3.991444669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret") pod "global-pull-secret-syncer-5vt46" (UID: "293c10fa-e12e-4eae-a937-5a2f26cac6d7") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:28.636645 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.636628 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx podName:6f7d9efa-2c21-4519-a32e-61cd3eb09f3d nodeName:}" failed. No retries permitted until 2026-07-17 17:49:29.636621861 +0000 UTC m=+3.991473419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ql2nx" (UniqueName: "kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx") pod "network-check-target-z6h6q" (UID: "6f7d9efa-2c21-4519-a32e-61cd3eb09f3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:28.737441 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:28.737403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:28.737632 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.737582 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:28.737705 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:28.737651 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs podName:f5954494-0d8d-49e0-83bd-c538159c1142 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:29.73762844 +0000 UTC m=+4.092480000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs") pod "network-metrics-daemon-krdns" (UID: "f5954494-0d8d-49e0-83bd-c538159c1142") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:28.983187 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.983157 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7a696b_d2cb_435a_b96f_d4689a611561.slice/crio-d651dc1d991a1ae7dc40323e9d8041fdcc59bfa5dfb1a7b1fb577ac51eaa8e53 WatchSource:0}: Error finding container d651dc1d991a1ae7dc40323e9d8041fdcc59bfa5dfb1a7b1fb577ac51eaa8e53: Status 404 returned error can't find the container with id d651dc1d991a1ae7dc40323e9d8041fdcc59bfa5dfb1a7b1fb577ac51eaa8e53 Jul 17 17:49:28.985486 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.985429 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80645c97_ff4e_44d9_aaf6_60443de654fb.slice/crio-e6836f724e70f566448784a362af2f577d5fd49e35d72911d00097ed5829b2a6 WatchSource:0}: Error finding container e6836f724e70f566448784a362af2f577d5fd49e35d72911d00097ed5829b2a6: Status 404 returned error can't find the container with id e6836f724e70f566448784a362af2f577d5fd49e35d72911d00097ed5829b2a6 Jul 17 17:49:28.988993 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.988963 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2a4f21_25e1_4274_b43b_e1dc56f97250.slice/crio-cfb9ff569017c84c5dbbfd6166fa770767ca5dca11d473115e284355cc324e22 WatchSource:0}: Error finding container cfb9ff569017c84c5dbbfd6166fa770767ca5dca11d473115e284355cc324e22: Status 404 returned error can't find the container with id cfb9ff569017c84c5dbbfd6166fa770767ca5dca11d473115e284355cc324e22 Jul 17 17:49:28.989204 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.989185 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6382d403_d5f4_41ab_b0e6_2087ebf9d4a4.slice/crio-f986a8dd5539fef8581c0f81336f7e134986f18672914f087323c0b033e3c77a WatchSource:0}: Error finding container f986a8dd5539fef8581c0f81336f7e134986f18672914f087323c0b033e3c77a: Status 404 returned error can't find the container with id f986a8dd5539fef8581c0f81336f7e134986f18672914f087323c0b033e3c77a Jul 17 17:49:28.989982 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.989958 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb10f06a8_9d82_4270_bc05_d6654c98e6c0.slice/crio-9342e68f4beea2989c989f9de9b323b72e49dce9f31e49261ce014f85b9b71e6 WatchSource:0}: Error finding container 9342e68f4beea2989c989f9de9b323b72e49dce9f31e49261ce014f85b9b71e6: Status 404 returned error can't find the container with id 9342e68f4beea2989c989f9de9b323b72e49dce9f31e49261ce014f85b9b71e6 Jul 17 17:49:28.990657 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.990582 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06bdc7aa_4d36_49db_81a2_fc4752b6629c.slice/crio-3370690a4e482d069fe746513bba23cae3ebee466dad6e08689acaee2a73372e WatchSource:0}: Error finding container 3370690a4e482d069fe746513bba23cae3ebee466dad6e08689acaee2a73372e: Status 404 returned error can't find the container with id 3370690a4e482d069fe746513bba23cae3ebee466dad6e08689acaee2a73372e Jul 17 17:49:28.992227 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.991404 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b9c982_255e_4782_b917_85ccca03653e.slice/crio-79d8ca6d100827b04ecc9a270b8740e3439727e296a46a92d55b11a18e002158 WatchSource:0}: Error finding container 79d8ca6d100827b04ecc9a270b8740e3439727e296a46a92d55b11a18e002158: Status 404 returned error can't find the container with id 79d8ca6d100827b04ecc9a270b8740e3439727e296a46a92d55b11a18e002158 Jul 17 17:49:28.992818 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.992719 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d79024_5b82_4116_9f69_d76f36c7b0ee.slice/crio-42855c2a19b236472810eb2df997e693366ad6d5f46c98aacbd5619643263a69 WatchSource:0}: Error finding container 42855c2a19b236472810eb2df997e693366ad6d5f46c98aacbd5619643263a69: Status 404 returned error can't find the container with id 42855c2a19b236472810eb2df997e693366ad6d5f46c98aacbd5619643263a69 Jul 17 17:49:28.994476 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:49:28.994453 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3309a02_8972_48d1_9a5e_444ca7372c65.slice/crio-ba475b011edb9ee5c19d68c043d511603bbb8a41e82fad7dac284714ce037c82 WatchSource:0}: Error finding container ba475b011edb9ee5c19d68c043d511603bbb8a41e82fad7dac284714ce037c82: Status 404 returned error can't find the container with id ba475b011edb9ee5c19d68c043d511603bbb8a41e82fad7dac284714ce037c82 Jul 17 17:49:29.057489 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.057449 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:44:28 +0000 UTC" deadline="2028-03-09 06:44:29.941349968 +0000 UTC" Jul 17 17:49:29.057489 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.057486 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14412h55m0.883868167s" Jul 17 17:49:29.137530 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.137498 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"f986a8dd5539fef8581c0f81336f7e134986f18672914f087323c0b033e3c77a"} Jul 17 17:49:29.138733 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.138699 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqpx4" event={"ID":"82b9c982-255e-4782-b917-85ccca03653e","Type":"ContainerStarted","Data":"79d8ca6d100827b04ecc9a270b8740e3439727e296a46a92d55b11a18e002158"} Jul 17 17:49:29.139856 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.139823 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6w6br" event={"ID":"06bdc7aa-4d36-49db-81a2-fc4752b6629c","Type":"ContainerStarted","Data":"3370690a4e482d069fe746513bba23cae3ebee466dad6e08689acaee2a73372e"} Jul 17 17:49:29.140832 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.140808 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5dnv" event={"ID":"b10f06a8-9d82-4270-bc05-d6654c98e6c0","Type":"ContainerStarted","Data":"9342e68f4beea2989c989f9de9b323b72e49dce9f31e49261ce014f85b9b71e6"} Jul 17 17:49:29.142181 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.142156 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" event={"ID":"fa2a4f21-25e1-4274-b43b-e1dc56f97250","Type":"ContainerStarted","Data":"cfb9ff569017c84c5dbbfd6166fa770767ca5dca11d473115e284355cc324e22"} Jul 17 17:49:29.143243 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.143216 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q68qj" event={"ID":"80645c97-ff4e-44d9-aaf6-60443de654fb","Type":"ContainerStarted","Data":"e6836f724e70f566448784a362af2f577d5fd49e35d72911d00097ed5829b2a6"} Jul 17 17:49:29.144389 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.144366 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f698w" event={"ID":"9d7a696b-d2cb-435a-b96f-d4689a611561","Type":"ContainerStarted","Data":"d651dc1d991a1ae7dc40323e9d8041fdcc59bfa5dfb1a7b1fb577ac51eaa8e53"} Jul 17 17:49:29.146648 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.146624 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" event={"ID":"31783b4ed77dfc64030a66f386750024","Type":"ContainerStarted","Data":"60ee3158be57d7b7c5a432261534b039eaa88ed9284ce7c6ac5620ea394f8994"} Jul 17 17:49:29.147775 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.147744 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zggz" event={"ID":"b3309a02-8972-48d1-9a5e-444ca7372c65","Type":"ContainerStarted","Data":"ba475b011edb9ee5c19d68c043d511603bbb8a41e82fad7dac284714ce037c82"} Jul 17 17:49:29.148955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.148937 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerStarted","Data":"42855c2a19b236472810eb2df997e693366ad6d5f46c98aacbd5619643263a69"} Jul 17 17:49:29.161400 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.161347 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" podStartSLOduration=1.161326935 podStartE2EDuration="1.161326935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:29.160693575 +0000 UTC m=+3.515545160" watchObservedRunningTime="2026-07-17 17:49:29.161326935 +0000 UTC m=+3.516178519" Jul 17 17:49:29.266500 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.266437 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.646472 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.646547 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.646723 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.646744 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.646758 2552 projected.go:196] Error preparing data for projected volume kube-api-access-ql2nx for pod openshift-network-diagnostics/network-check-target-z6h6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.646815 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx podName:6f7d9efa-2c21-4519-a32e-61cd3eb09f3d nodeName:}" failed. No retries permitted until 2026-07-17 17:49:31.64679708 +0000 UTC m=+6.001648657 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ql2nx" (UniqueName: "kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx") pod "network-check-target-z6h6q" (UID: "6f7d9efa-2c21-4519-a32e-61cd3eb09f3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.646904 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:29.647333 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.646939 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret podName:293c10fa-e12e-4eae-a937-5a2f26cac6d7 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:31.646928002 +0000 UTC m=+6.001779568 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret") pod "global-pull-secret-syncer-5vt46" (UID: "293c10fa-e12e-4eae-a937-5a2f26cac6d7") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:29.747676 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:29.747135 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:29.747676 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.747277 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:29.747676 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:29.747340 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs podName:f5954494-0d8d-49e0-83bd-c538159c1142 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:31.747318488 +0000 UTC m=+6.102170048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs") pod "network-metrics-daemon-krdns" (UID: "f5954494-0d8d-49e0-83bd-c538159c1142") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:30.058013 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:30.057888 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:44:28 +0000 UTC" deadline="2028-02-03 04:48:17.6388561 +0000 UTC" Jul 17 17:49:30.058013 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:30.057946 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13570h58m47.580913555s" Jul 17 17:49:30.124640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:30.123629 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:30.124640 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:30.123763 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:30.124640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:30.123891 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:30.124640 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:30.123987 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:30.124640 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:30.124046 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:30.124640 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:30.124116 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:30.166389 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:30.166348 2552 generic.go:356] "Generic (PLEG): container finished" podID="0c6d814b9e1fe3f97302765f12ed4851" containerID="46c7e16fcb82e3e7824ba82d5fc72a5fb482b2291bc22f1fadbaacfe3e7aafc8" exitCode=0 Jul 17 17:49:30.167795 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:30.167547 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"0c6d814b9e1fe3f97302765f12ed4851","Type":"ContainerDied","Data":"46c7e16fcb82e3e7824ba82d5fc72a5fb482b2291bc22f1fadbaacfe3e7aafc8"} Jul 17 17:49:31.179843 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:31.179798 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"0c6d814b9e1fe3f97302765f12ed4851","Type":"ContainerStarted","Data":"e31fdac89cdddc5600846e792c567acf566f210ee0b06ed65b601343855d5972"} Jul 17 17:49:31.665205 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:31.665163 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:31.665390 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:31.665239 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:31.665447 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.665396 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:31.665447 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.665418 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:31.665447 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.665431 2552 projected.go:196] Error preparing data for projected volume kube-api-access-ql2nx for pod openshift-network-diagnostics/network-check-target-z6h6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:31.665563 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.665491 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx podName:6f7d9efa-2c21-4519-a32e-61cd3eb09f3d nodeName:}" failed. No retries permitted until 2026-07-17 17:49:35.665471317 +0000 UTC m=+10.020322894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ql2nx" (UniqueName: "kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx") pod "network-check-target-z6h6q" (UID: "6f7d9efa-2c21-4519-a32e-61cd3eb09f3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:31.665911 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.665892 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:31.665993 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.665945 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret podName:293c10fa-e12e-4eae-a937-5a2f26cac6d7 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:35.665931528 +0000 UTC m=+10.020783101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret") pod "global-pull-secret-syncer-5vt46" (UID: "293c10fa-e12e-4eae-a937-5a2f26cac6d7") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:31.766164 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:31.766123 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:31.766408 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.766365 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:31.766475 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:31.766433 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs podName:f5954494-0d8d-49e0-83bd-c538159c1142 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:35.766413976 +0000 UTC m=+10.121265537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs") pod "network-metrics-daemon-krdns" (UID: "f5954494-0d8d-49e0-83bd-c538159c1142") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:32.121903 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:32.120894 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:32.121903 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:32.121033 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:32.121903 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:32.121366 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:32.121903 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:32.121467 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:32.121903 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:32.121509 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:32.121903 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:32.121581 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:34.124825 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:34.124793 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:34.125302 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:34.124938 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:34.125302 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:34.125026 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:34.125302 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:34.125094 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:34.125302 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:34.125150 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:34.125302 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:34.125217 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:35.700501 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:35.700594 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.700750 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.700813 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret podName:293c10fa-e12e-4eae-a937-5a2f26cac6d7 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:43.70079422 +0000 UTC m=+18.055645784 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret") pod "global-pull-secret-syncer-5vt46" (UID: "293c10fa-e12e-4eae-a937-5a2f26cac6d7") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.701270 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.701289 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.701302 2552 projected.go:196] Error preparing data for projected volume kube-api-access-ql2nx for pod openshift-network-diagnostics/network-check-target-z6h6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:35.701384 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.701345 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx podName:6f7d9efa-2c21-4519-a32e-61cd3eb09f3d nodeName:}" failed. No retries permitted until 2026-07-17 17:49:43.701330976 +0000 UTC m=+18.056182539 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ql2nx" (UniqueName: "kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx") pod "network-check-target-z6h6q" (UID: "6f7d9efa-2c21-4519-a32e-61cd3eb09f3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:35.802067 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:35.802029 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:35.802246 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.802196 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:35.802287 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:35.802257 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs podName:f5954494-0d8d-49e0-83bd-c538159c1142 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:43.802241218 +0000 UTC m=+18.157092776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs") pod "network-metrics-daemon-krdns" (UID: "f5954494-0d8d-49e0-83bd-c538159c1142") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:36.124749 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:36.120897 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:36.124749 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:36.121046 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:36.124749 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:36.122413 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:36.124749 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:36.122522 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:36.124749 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:36.122574 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:36.124749 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:36.122635 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:38.121508 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:38.121236 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:38.121508 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:38.121293 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:38.121508 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:38.121235 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:38.121508 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:38.121365 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:38.121508 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:38.121453 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:38.122063 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:38.121524 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:40.123721 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:40.123673 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:40.124225 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:40.123813 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:40.124312 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:40.124228 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:40.124360 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:40.124328 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:40.124420 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:40.124380 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:40.124468 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:40.124453 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:42.121508 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:42.121472 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:42.121958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:42.121472 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:42.121958 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:42.121628 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:42.121958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:42.121644 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:42.121958 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:42.121728 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:42.121958 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:42.121816 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:43.763027 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:43.762990 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:43.763414 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:43.763056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:43.763414 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.763121 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:43.763414 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.763185 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:43.763414 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.763195 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret podName:293c10fa-e12e-4eae-a937-5a2f26cac6d7 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:59.763176744 +0000 UTC m=+34.118028302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret") pod "global-pull-secret-syncer-5vt46" (UID: "293c10fa-e12e-4eae-a937-5a2f26cac6d7") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:43.763414 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.763199 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:43.763414 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.763209 2552 projected.go:196] Error preparing data for projected volume kube-api-access-ql2nx for pod openshift-network-diagnostics/network-check-target-z6h6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:43.763414 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.763252 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx podName:6f7d9efa-2c21-4519-a32e-61cd3eb09f3d nodeName:}" failed. No retries permitted until 2026-07-17 17:49:59.763237121 +0000 UTC m=+34.118088679 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ql2nx" (UniqueName: "kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx") pod "network-check-target-z6h6q" (UID: "6f7d9efa-2c21-4519-a32e-61cd3eb09f3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:43.864290 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:43.864253 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:43.864477 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.864381 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:43.864477 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:43.864441 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs podName:f5954494-0d8d-49e0-83bd-c538159c1142 nodeName:}" failed. No retries permitted until 2026-07-17 17:49:59.864423764 +0000 UTC m=+34.219275329 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs") pod "network-metrics-daemon-krdns" (UID: "f5954494-0d8d-49e0-83bd-c538159c1142") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:44.121551 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:44.121513 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:44.121765 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:44.121658 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:44.121765 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:44.121513 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:44.121906 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:44.121765 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:44.121906 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:44.121513 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:44.121906 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:44.121854 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:46.122015 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:46.121977 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:46.122479 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:46.122096 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:46.122479 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:46.122140 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:46.122479 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:46.122277 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:46.122479 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:46.122300 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:46.122479 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:46.122428 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:48.121460 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:48.121431 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:48.121460 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:48.121464 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:48.122022 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:48.121430 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:48.122022 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:48.121556 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:48.122022 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:48.121628 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:48.122022 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:48.121708 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:49.221626 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.220951 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6w6br" event={"ID":"06bdc7aa-4d36-49db-81a2-fc4752b6629c","Type":"ContainerStarted","Data":"6a0a40c38bfa70ded487bd9f1c68720b2f142f00e4342b8be4ace522f241f750"} Jul 17 17:49:49.222819 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.222786 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" event={"ID":"fa2a4f21-25e1-4274-b43b-e1dc56f97250","Type":"ContainerStarted","Data":"1099bc8e45d79734b971b259b1c4967a3403677433b427cdc4cbad99016d3370"} Jul 17 17:49:49.224695 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.224662 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q68qj" event={"ID":"80645c97-ff4e-44d9-aaf6-60443de654fb","Type":"ContainerStarted","Data":"063cfbd4cdd2770e59badcad20a04ed3311d43ee0495e3c7cb49faec26b401c7"} Jul 17 17:49:49.227142 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.227108 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f698w" event={"ID":"9d7a696b-d2cb-435a-b96f-d4689a611561","Type":"ContainerStarted","Data":"04cfb77d562ccfdaeaf446e06e208a8c45bb5a7030b86935248f58f7655518ab"} Jul 17 17:49:49.230626 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.228962 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7zggz" event={"ID":"b3309a02-8972-48d1-9a5e-444ca7372c65","Type":"ContainerStarted","Data":"b1739ffc96ba2fdc41601eb09d8d66cd1387df6d3bbe8557dd8488e2140e625c"} Jul 17 17:49:49.230898 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.230847 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9d79024-5b82-4116-9f69-d76f36c7b0ee" containerID="ca9407f1d1224a26ddca3d3c27865b9dff588007e49bf487ff21a10d1565d32f" exitCode=0 Jul 17 17:49:49.231012 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.230959 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerDied","Data":"ca9407f1d1224a26ddca3d3c27865b9dff588007e49bf487ff21a10d1565d32f"} Jul 17 17:49:49.235352 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.235323 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"cf08e1556ba6721b3242751062fe69f0a038d9cca07c1a7e2ec251ce0754136d"} Jul 17 17:49:49.235462 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.235390 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"e0b25f5ce6ba77606683bd5b3d17708c16f6c47f8825ceff2cc00d8c82d41f70"} Jul 17 17:49:49.235462 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.235423 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"3f3c669e5f48d302ec836307c439aed00d631804975ae9a163f95a6da6c16c5e"} Jul 17 17:49:49.235462 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.235458 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"837b6b88b0a3805172ba608074be3b32867016005aee45c2b017950562ca6e88"} Jul 17 17:49:49.235604 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.235498 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"81607fe7b80f443412234eaae34aba31f7746fc139ceefb0c542e381dd4e8287"} Jul 17 17:49:49.235604 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.235576 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"716477bc10d2645d912343351b1e09c0e25e069ae5e375079b26928781c3fd7f"} Jul 17 17:49:49.237133 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.237107 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vqpx4" event={"ID":"82b9c982-255e-4782-b917-85ccca03653e","Type":"ContainerStarted","Data":"0c3d35ad17a9dc36c3e1af2698dfef7d7c4f3b1eb7e10cfd0540b964f7064ef3"} Jul 17 17:49:49.241145 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.241088 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" podStartSLOduration=21.241069088 podStartE2EDuration="21.241069088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:31.196747428 +0000 UTC m=+5.551599008" watchObservedRunningTime="2026-07-17 17:49:49.241069088 +0000 UTC m=+23.595920669" Jul 17 17:49:49.241395 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.241359 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6w6br" podStartSLOduration=3.997597587 podStartE2EDuration="23.24134725s" totalImagesPullingTime="19.243749663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:49.240339696 +0000 UTC m=+23.595191275" watchObservedRunningTime="2026-07-17 17:49:49.24134725 +0000 UTC m=+23.596198833" Jul 17 17:49:49.254761 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.254712 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q68qj" podStartSLOduration=4.035952008 podStartE2EDuration="23.25469315s" totalImagesPullingTime="19.218741142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:49.254215233 +0000 UTC m=+23.609066815" watchObservedRunningTime="2026-07-17 17:49:49.25469315 +0000 UTC m=+23.609544730" Jul 17 17:49:49.268466 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.268410 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7zggz" podStartSLOduration=4.053893496 podStartE2EDuration="23.268393878s" totalImagesPullingTime="19.214500382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:49.26817578 +0000 UTC m=+23.623027359" watchObservedRunningTime="2026-07-17 17:49:49.268393878 +0000 UTC m=+23.623245457" Jul 17 17:49:49.306079 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.306017 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f698w" podStartSLOduration=4.021043106 podStartE2EDuration="23.305998657s" totalImagesPullingTime="19.284955551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:49.305504859 +0000 UTC m=+23.660356441" watchObservedRunningTime="2026-07-17 17:49:49.305998657 +0000 UTC m=+23.660850237" Jul 17 17:49:49.319799 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.319742 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vqpx4" podStartSLOduration=8.63921804 podStartE2EDuration="23.319726014s" totalImagesPullingTime="14.680507974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:49.319443608 +0000 UTC m=+23.674295188" watchObservedRunningTime="2026-07-17 17:49:49.319726014 +0000 UTC m=+23.674577594" Jul 17 17:49:49.763399 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:49.763364 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 17:49:50.076369 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.076253 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T17:49:49.763390831Z","UUID":"e8e80ff1-0c3b-4606-babb-6276f19a5946","Handler":null,"Name":"","Endpoint":""} Jul 17 17:49:50.077912 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.077885 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 17:49:50.078051 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.077924 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 17:49:50.121497 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.121463 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:50.121687 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:50.121576 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:50.121687 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.121587 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:50.121687 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.121463 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:50.121800 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:50.121679 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:50.121800 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:50.121751 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:50.242188 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.242146 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h5dnv" event={"ID":"b10f06a8-9d82-4270-bc05-d6654c98e6c0","Type":"ContainerStarted","Data":"62de39128352a1882a2de1b7458d5db4290b8c9d889e658eef01b3aedb474df7"} Jul 17 17:49:50.244656 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.244590 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" event={"ID":"fa2a4f21-25e1-4274-b43b-e1dc56f97250","Type":"ContainerStarted","Data":"eea8b0b861963a50adc31d2a2eba00dfb2f76bb3745ac30731d244292548ce2b"} Jul 17 17:49:50.260816 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:50.260756 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h5dnv" podStartSLOduration=5.046932898 podStartE2EDuration="24.260736722s" totalImagesPullingTime="19.213803824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:50.260557247 +0000 UTC m=+24.615408829" watchObservedRunningTime="2026-07-17 17:49:50.260736722 +0000 UTC m=+24.615588303" Jul 17 17:49:51.088216 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:51.088135 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:51.249308 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:51.249226 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" event={"ID":"fa2a4f21-25e1-4274-b43b-e1dc56f97250","Type":"ContainerStarted","Data":"fc53bc05743850979a46e27121c397fc2c7c17f5f7c56235765f00db6baf5d18"} Jul 17 17:49:51.272674 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:51.272618 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqkvc" podStartSLOduration=3.779295481 podStartE2EDuration="25.27259466s" totalImagesPullingTime="21.493299179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:51.271986029 +0000 UTC m=+25.626837610" watchObservedRunningTime="2026-07-17 17:49:51.27259466 +0000 UTC m=+25.627446240" Jul 17 17:49:52.047109 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:52.047054 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:52.047802 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:52.047771 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:52.121543 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:52.121503 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:52.121543 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:52.121540 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:52.121789 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:52.121503 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:52.121789 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:52.121643 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:52.121789 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:52.121725 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:52.121973 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:52.121822 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:52.255482 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:52.255445 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"489c9bebf4fba506877f037a59511be21d4875855c58d8aecec037b816684193"} Jul 17 17:49:52.256340 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:52.256313 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vqpx4" Jul 17 17:49:54.121886 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:54.121670 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:54.122538 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:54.121670 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:54.122538 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:54.121991 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:54.122538 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:54.121703 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:54.122538 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:54.122057 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:54.122538 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:54.122154 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:54.262230 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:54.262195 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9d79024-5b82-4116-9f69-d76f36c7b0ee" containerID="e2b456e3c07854832d54ec971e349ff806f848a32f16ec9a221f3d8df0032d09" exitCode=0 Jul 17 17:49:54.262400 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:54.262238 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerDied","Data":"e2b456e3c07854832d54ec971e349ff806f848a32f16ec9a221f3d8df0032d09"} Jul 17 17:49:54.265946 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:54.265921 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" event={"ID":"6382d403-d5f4-41ab-b0e6-2087ebf9d4a4","Type":"ContainerStarted","Data":"6b48a4b700f6d6b1cfde8dc4eada2bffd183d3ee13fca4c179f5f66037e825df"} Jul 17 17:49:54.314273 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:54.314214 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" podStartSLOduration=9.022933551 podStartE2EDuration="28.314197581s" totalImagesPullingTime="19.29126403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:49:54.313797271 +0000 UTC m=+28.668648862" watchObservedRunningTime="2026-07-17 17:49:54.314197581 +0000 UTC m=+28.669049161" Jul 17 17:49:55.268746 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.268523 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:55.269269 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.268821 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:55.269269 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.268881 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:55.285298 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.285269 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:55.285492 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.285410 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:49:55.400560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.400533 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vt46"] Jul 17 17:49:55.400687 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.400661 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:55.400803 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:55.400782 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:55.403918 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.403890 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-krdns"] Jul 17 17:49:55.404069 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.404013 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:55.404144 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:55.404124 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:55.404539 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.404524 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6h6q"] Jul 17 17:49:55.404623 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:55.404609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:55.404725 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:55.404705 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:56.272598 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:56.272559 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9d79024-5b82-4116-9f69-d76f36c7b0ee" containerID="f998ac65d16a401c0f5d313ca51cbd33365d2927576381ebec6294c42d15cfcb" exitCode=0 Jul 17 17:49:56.273095 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:56.272650 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerDied","Data":"f998ac65d16a401c0f5d313ca51cbd33365d2927576381ebec6294c42d15cfcb"} Jul 17 17:49:57.121528 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:57.121343 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:57.121707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:57.121357 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:57.121707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:57.121601 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:57.121707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:57.121667 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:57.121707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:57.121426 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:57.121836 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:57.121744 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:58.279648 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:58.279610 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9d79024-5b82-4116-9f69-d76f36c7b0ee" containerID="6b73bf713c872c33bed4843eb9eef9807a6b4f4340589cf9219e92fd3e501955" exitCode=0 Jul 17 17:49:58.280135 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:58.279678 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerDied","Data":"6b73bf713c872c33bed4843eb9eef9807a6b4f4340589cf9219e92fd3e501955"} Jul 17 17:49:59.120958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:59.120923 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:59.121151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:59.120962 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:59.121151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:59.120920 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:59.121151 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.121060 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-krdns" podUID="f5954494-0d8d-49e0-83bd-c538159c1142" Jul 17 17:49:59.121294 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.121192 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z6h6q" podUID="6f7d9efa-2c21-4519-a32e-61cd3eb09f3d" Jul 17 17:49:59.121344 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.121294 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5vt46" podUID="293c10fa-e12e-4eae-a937-5a2f26cac6d7" Jul 17 17:49:59.778539 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:59.778495 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:49:59.778992 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:59.778576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:49:59.778992 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.778699 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:59.778992 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.778712 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 17:49:59.778992 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.778729 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 17:49:59.778992 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.778740 2552 projected.go:196] Error preparing data for projected volume kube-api-access-ql2nx for pod openshift-network-diagnostics/network-check-target-z6h6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:59.778992 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.778756 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret podName:293c10fa-e12e-4eae-a937-5a2f26cac6d7 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:31.778736295 +0000 UTC m=+66.133587854 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret") pod "global-pull-secret-syncer-5vt46" (UID: "293c10fa-e12e-4eae-a937-5a2f26cac6d7") : object "kube-system"/"original-pull-secret" not registered Jul 17 17:49:59.778992 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.778773 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx podName:6f7d9efa-2c21-4519-a32e-61cd3eb09f3d nodeName:}" failed. No retries permitted until 2026-07-17 17:50:31.778763718 +0000 UTC m=+66.133615292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ql2nx" (UniqueName: "kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx") pod "network-check-target-z6h6q" (UID: "6f7d9efa-2c21-4519-a32e-61cd3eb09f3d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 17:49:59.879741 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:49:59.879702 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:49:59.879949 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.879891 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:49:59.880025 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:49:59.879972 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs podName:f5954494-0d8d-49e0-83bd-c538159c1142 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:31.879949603 +0000 UTC m=+66.234801166 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs") pod "network-metrics-daemon-krdns" (UID: "f5954494-0d8d-49e0-83bd-c538159c1142") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 17:50:00.041592 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.041505 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zggz_b3309a02-8972-48d1-9a5e-444ca7372c65/dns-node-resolver/0.log" Jul 17 17:50:00.897501 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.897470 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeReady" Jul 17 17:50:00.897984 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.897649 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 17:50:00.933841 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.933800 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59c9569b7-wghnb"] Jul 17 17:50:00.936399 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.936375 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:00.939676 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.939646 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 17:50:00.939827 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.939702 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 17:50:00.939827 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.939659 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 17:50:00.939827 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.939733 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-szkls\"" Jul 17 17:50:00.948973 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.946985 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qchpg"] Jul 17 17:50:00.951765 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.951713 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vlhxt"] Jul 17 17:50:00.951937 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.951814 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:00.952094 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.952068 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 17:50:00.954943 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.954920 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c9569b7-wghnb"] Jul 17 17:50:00.955054 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.955020 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:00.955968 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.955935 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 17:50:00.956085 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.955983 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-66fzz\"" Jul 17 17:50:00.956085 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.955947 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 17:50:00.959224 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.959192 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 17:50:00.959396 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.959309 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 17:50:00.959470 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.959384 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 17:50:00.959470 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.959427 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4fmcs\"" Jul 17 17:50:00.963050 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.963026 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qchpg"] Jul 17 17:50:00.963791 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.963752 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlhxt"] Jul 17 17:50:00.971656 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.971632 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-426kp"] Jul 17 17:50:00.973615 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.973595 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:00.976612 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.976581 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 17:50:00.976783 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.976645 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s6zth\"" Jul 17 17:50:00.976783 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.976691 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 17:50:00.976918 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.976851 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 17:50:00.976977 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.976951 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 17:50:00.986562 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:00.986503 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-426kp"] Jul 17 17:50:01.088736 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.088705 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.088736 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.088742 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.089000 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.088765 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/490bc3e2-9faf-4468-b685-73439896a055-cert\") pod \"ingress-canary-vlhxt\" (UID: \"490bc3e2-9faf-4468-b685-73439896a055\") " pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:01.089000 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.088796 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zwml\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-kube-api-access-4zwml\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.089000 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.088898 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.089000 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.088928 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkxpm\" (UniqueName: \"kubernetes.io/projected/54f90a91-768c-4f1b-8740-4fd0eb7cf225-kube-api-access-vkxpm\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.089000 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.088988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54f90a91-768c-4f1b-8740-4fd0eb7cf225-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-ca-trust-extracted\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089042 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02f8f280-7e28-4ba5-a187-e36cd2d0d099-config-volume\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089066 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02f8f280-7e28-4ba5-a187-e36cd2d0d099-tmp-dir\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089103 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-certificates\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089133 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-trusted-ca\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089148 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-installation-pull-secrets\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089169 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-bound-sa-token\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.089222 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089206 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2brw\" (UniqueName: \"kubernetes.io/projected/02f8f280-7e28-4ba5-a187-e36cd2d0d099-kube-api-access-v2brw\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.089530 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089288 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54f90a91-768c-4f1b-8740-4fd0eb7cf225-crio-socket\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.089530 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089320 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f90a91-768c-4f1b-8740-4fd0eb7cf225-data-volume\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.089530 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089396 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-image-registry-private-configuration\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.089530 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.089427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdhw\" (UniqueName: \"kubernetes.io/projected/490bc3e2-9faf-4468-b685-73439896a055-kube-api-access-cwdhw\") pod \"ingress-canary-vlhxt\" (UID: \"490bc3e2-9faf-4468-b685-73439896a055\") " pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:01.120873 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.120832 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:50:01.121059 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.120846 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:50:01.121378 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.120846 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:50:01.124151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.123932 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:50:01.124151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.123949 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:50:01.124151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.123944 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 17:50:01.124151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.123982 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlkcj\"" Jul 17 17:50:01.124151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.124044 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgrcl\"" Jul 17 17:50:01.124421 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.124199 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 17:50:01.190691 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.190654 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.190891 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.190704 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkxpm\" (UniqueName: \"kubernetes.io/projected/54f90a91-768c-4f1b-8740-4fd0eb7cf225-kube-api-access-vkxpm\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.190891 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.190831 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:01.190891 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.190851 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54f90a91-768c-4f1b-8740-4fd0eb7cf225-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.191055 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.190905 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-ca-trust-extracted\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191055 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.190927 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls podName:54f90a91-768c-4f1b-8740-4fd0eb7cf225 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:01.690908428 +0000 UTC m=+36.045759986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls") pod "insights-runtime-extractor-426kp" (UID: "54f90a91-768c-4f1b-8740-4fd0eb7cf225") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:01.191055 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.190955 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02f8f280-7e28-4ba5-a187-e36cd2d0d099-config-volume\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.191055 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.190976 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02f8f280-7e28-4ba5-a187-e36cd2d0d099-tmp-dir\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.191251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191052 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-certificates\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191102 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-trusted-ca\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191129 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-installation-pull-secrets\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-bound-sa-token\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191193 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2brw\" (UniqueName: \"kubernetes.io/projected/02f8f280-7e28-4ba5-a187-e36cd2d0d099-kube-api-access-v2brw\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.191251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191222 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54f90a91-768c-4f1b-8740-4fd0eb7cf225-crio-socket\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.191251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191243 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f90a91-768c-4f1b-8740-4fd0eb7cf225-data-volume\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191289 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-image-registry-private-configuration\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191317 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdhw\" (UniqueName: \"kubernetes.io/projected/490bc3e2-9faf-4468-b685-73439896a055-kube-api-access-cwdhw\") pod \"ingress-canary-vlhxt\" (UID: \"490bc3e2-9faf-4468-b685-73439896a055\") " pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191358 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02f8f280-7e28-4ba5-a187-e36cd2d0d099-tmp-dir\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191379 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-ca-trust-extracted\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/490bc3e2-9faf-4468-b685-73439896a055-cert\") pod \"ingress-canary-vlhxt\" (UID: \"490bc3e2-9faf-4468-b685-73439896a055\") " pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zwml\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-kube-api-access-4zwml\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.191464 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:50:01.191563 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.191525 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls podName:02f8f280-7e28-4ba5-a187-e36cd2d0d099 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:01.69150707 +0000 UTC m=+36.046358637 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls") pod "dns-default-qchpg" (UID: "02f8f280-7e28-4ba5-a187-e36cd2d0d099") : secret "dns-default-metrics-tls" not found Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191573 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54f90a91-768c-4f1b-8740-4fd0eb7cf225-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191608 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02f8f280-7e28-4ba5-a187-e36cd2d0d099-config-volume\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191633 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-certificates\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191760 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54f90a91-768c-4f1b-8740-4fd0eb7cf225-data-volume\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.191803 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54f90a91-768c-4f1b-8740-4fd0eb7cf225-crio-socket\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.191923 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.191937 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c9569b7-wghnb: secret "image-registry-tls" not found Jul 17 17:50:01.192063 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.192030 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls podName:0098fd6d-937a-4cfa-9068-a5fdd729cdb1 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:01.692014125 +0000 UTC m=+36.046865698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls") pod "image-registry-59c9569b7-wghnb" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1") : secret "image-registry-tls" not found Jul 17 17:50:01.192479 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.192457 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-trusted-ca\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.196402 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.196376 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/490bc3e2-9faf-4468-b685-73439896a055-cert\") pod \"ingress-canary-vlhxt\" (UID: \"490bc3e2-9faf-4468-b685-73439896a055\") " pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:01.196535 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.196376 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-installation-pull-secrets\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.196535 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.196382 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-image-registry-private-configuration\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.204551 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.204520 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q68qj_80645c97-ff4e-44d9-aaf6-60443de654fb/node-ca/0.log" Jul 17 17:50:01.206310 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.206273 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2brw\" (UniqueName: \"kubernetes.io/projected/02f8f280-7e28-4ba5-a187-e36cd2d0d099-kube-api-access-v2brw\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.206780 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.206756 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-bound-sa-token\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.206944 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.206897 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdhw\" (UniqueName: \"kubernetes.io/projected/490bc3e2-9faf-4468-b685-73439896a055-kube-api-access-cwdhw\") pod \"ingress-canary-vlhxt\" (UID: \"490bc3e2-9faf-4468-b685-73439896a055\") " pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:01.207240 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.207217 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkxpm\" (UniqueName: \"kubernetes.io/projected/54f90a91-768c-4f1b-8740-4fd0eb7cf225-kube-api-access-vkxpm\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.209521 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.209502 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zwml\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-kube-api-access-4zwml\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.270932 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.270894 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlhxt" Jul 17 17:50:01.697165 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.697058 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:01.697165 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.697110 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:01.697165 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:01.697154 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:01.697429 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.697220 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:50:01.697429 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.697238 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c9569b7-wghnb: secret "image-registry-tls" not found Jul 17 17:50:01.697429 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.697300 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:50:01.697429 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.697309 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls podName:0098fd6d-937a-4cfa-9068-a5fdd729cdb1 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:02.69728986 +0000 UTC m=+37.052141441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls") pod "image-registry-59c9569b7-wghnb" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1") : secret "image-registry-tls" not found Jul 17 17:50:01.697429 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.697306 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:01.697429 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.697396 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls podName:02f8f280-7e28-4ba5-a187-e36cd2d0d099 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:02.697376993 +0000 UTC m=+37.052228557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls") pod "dns-default-qchpg" (UID: "02f8f280-7e28-4ba5-a187-e36cd2d0d099") : secret "dns-default-metrics-tls" not found Jul 17 17:50:01.697646 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:01.697461 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls podName:54f90a91-768c-4f1b-8740-4fd0eb7cf225 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:02.697439967 +0000 UTC m=+37.052291552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls") pod "insights-runtime-extractor-426kp" (UID: "54f90a91-768c-4f1b-8740-4fd0eb7cf225") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:02.343812 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.343561 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlhxt"] Jul 17 17:50:02.347365 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:02.347339 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490bc3e2_9faf_4468_b685_73439896a055.slice/crio-bed0c626e6b525d2d06af822dd5354a746000ceba5fbe8cf7da9e8663ef613b1 WatchSource:0}: Error finding container bed0c626e6b525d2d06af822dd5354a746000ceba5fbe8cf7da9e8663ef613b1: Status 404 returned error can't find the container with id bed0c626e6b525d2d06af822dd5354a746000ceba5fbe8cf7da9e8663ef613b1 Jul 17 17:50:02.490110 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.490000 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-n7btl"] Jul 17 17:50:02.491695 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.491679 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.494448 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.494426 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 17 17:50:02.495818 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.495796 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 17 17:50:02.495918 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.495836 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 17 17:50:02.495980 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.495932 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4mnf4\"" Jul 17 17:50:02.496235 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.496218 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 17 17:50:02.500128 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.500101 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-n7btl"] Jul 17 17:50:02.607118 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.607085 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-signing-cabundle\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.607118 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.607122 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-signing-key\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.607331 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.607143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqk67\" (UniqueName: \"kubernetes.io/projected/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-kube-api-access-gqk67\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.707787 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.707749 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:02.707787 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.707792 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:02.708026 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.707825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:02.708026 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.707845 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-signing-cabundle\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.708026 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.707884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-signing-key\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.708026 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.707939 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqk67\" (UniqueName: \"kubernetes.io/projected/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-kube-api-access-gqk67\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.708026 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:02.707953 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:50:02.708178 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:02.708031 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c9569b7-wghnb: secret "image-registry-tls" not found Jul 17 17:50:02.708178 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:02.707965 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:50:02.708178 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:02.708090 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls podName:0098fd6d-937a-4cfa-9068-a5fdd729cdb1 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.708070234 +0000 UTC m=+39.062921809 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls") pod "image-registry-59c9569b7-wghnb" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1") : secret "image-registry-tls" not found Jul 17 17:50:02.708178 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:02.708118 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls podName:02f8f280-7e28-4ba5-a187-e36cd2d0d099 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.708106637 +0000 UTC m=+39.062958196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls") pod "dns-default-qchpg" (UID: "02f8f280-7e28-4ba5-a187-e36cd2d0d099") : secret "dns-default-metrics-tls" not found Jul 17 17:50:02.708178 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:02.708001 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:02.708178 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:02.708151 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls podName:54f90a91-768c-4f1b-8740-4fd0eb7cf225 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:04.708142752 +0000 UTC m=+39.062994311 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls") pod "insights-runtime-extractor-426kp" (UID: "54f90a91-768c-4f1b-8740-4fd0eb7cf225") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:02.708671 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.708649 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-signing-cabundle\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.711437 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.711419 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-signing-key\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.717021 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.717004 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqk67\" (UniqueName: \"kubernetes.io/projected/2a8d255c-12aa-45e1-a7cc-e9e27daeae7f-kube-api-access-gqk67\") pod \"service-ca-58598695f7-n7btl\" (UID: \"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f\") " pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.801695 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.801659 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-n7btl" Jul 17 17:50:02.947949 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:02.947913 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-n7btl"] Jul 17 17:50:02.952071 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:02.952039 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8d255c_12aa_45e1_a7cc_e9e27daeae7f.slice/crio-42198e86175c8afa4f47eedad1f4c605e53733310c4797762cc99b5d0da3b54b WatchSource:0}: Error finding container 42198e86175c8afa4f47eedad1f4c605e53733310c4797762cc99b5d0da3b54b: Status 404 returned error can't find the container with id 42198e86175c8afa4f47eedad1f4c605e53733310c4797762cc99b5d0da3b54b Jul 17 17:50:03.293586 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:03.293544 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-n7btl" event={"ID":"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f","Type":"ContainerStarted","Data":"42198e86175c8afa4f47eedad1f4c605e53733310c4797762cc99b5d0da3b54b"} Jul 17 17:50:03.296781 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:03.296743 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9d79024-5b82-4116-9f69-d76f36c7b0ee" containerID="fb83c18316497fb8f5fc7d19b16ef864afeb72697e8f12f11ded41fdcec73d0b" exitCode=0 Jul 17 17:50:03.296942 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:03.296819 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerDied","Data":"fb83c18316497fb8f5fc7d19b16ef864afeb72697e8f12f11ded41fdcec73d0b"} Jul 17 17:50:03.298295 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:03.298067 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlhxt" event={"ID":"490bc3e2-9faf-4468-b685-73439896a055","Type":"ContainerStarted","Data":"bed0c626e6b525d2d06af822dd5354a746000ceba5fbe8cf7da9e8663ef613b1"} Jul 17 17:50:04.305575 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:04.305248 2552 generic.go:356] "Generic (PLEG): container finished" podID="b9d79024-5b82-4116-9f69-d76f36c7b0ee" containerID="081c2c501743238f5c6bf9528d8005a765f18fb12748218e5b93d0858ae6a13a" exitCode=0 Jul 17 17:50:04.305575 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:04.305330 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerDied","Data":"081c2c501743238f5c6bf9528d8005a765f18fb12748218e5b93d0858ae6a13a"} Jul 17 17:50:04.727928 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:04.727888 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:04.727928 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:04.727934 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:04.728141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:04.727995 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:04.728141 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:04.728068 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:50:04.728141 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:04.728093 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c9569b7-wghnb: secret "image-registry-tls" not found Jul 17 17:50:04.728232 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:04.728141 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:04.728232 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:04.728163 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls podName:0098fd6d-937a-4cfa-9068-a5fdd729cdb1 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:08.728146792 +0000 UTC m=+43.082998350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls") pod "image-registry-59c9569b7-wghnb" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1") : secret "image-registry-tls" not found Jul 17 17:50:04.728232 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:04.728161 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:50:04.728232 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:04.728193 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls podName:54f90a91-768c-4f1b-8740-4fd0eb7cf225 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:08.728177667 +0000 UTC m=+43.083029243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls") pod "insights-runtime-extractor-426kp" (UID: "54f90a91-768c-4f1b-8740-4fd0eb7cf225") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:04.728232 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:04.728222 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls podName:02f8f280-7e28-4ba5-a187-e36cd2d0d099 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:08.728208282 +0000 UTC m=+43.083059862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls") pod "dns-default-qchpg" (UID: "02f8f280-7e28-4ba5-a187-e36cd2d0d099") : secret "dns-default-metrics-tls" not found Jul 17 17:50:06.314549 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:06.314507 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-52tzf" event={"ID":"b9d79024-5b82-4116-9f69-d76f36c7b0ee","Type":"ContainerStarted","Data":"1b3077a20ec2b364c360b6e0d30512c116a80936ea4a69ce8c09f139ba10dce5"} Jul 17 17:50:06.316071 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:06.316038 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlhxt" event={"ID":"490bc3e2-9faf-4468-b685-73439896a055","Type":"ContainerStarted","Data":"9354e429239f95e93ef0d8ec17773a2c8921643c464598890b681252169766e3"} Jul 17 17:50:06.317356 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:06.317334 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-n7btl" event={"ID":"2a8d255c-12aa-45e1-a7cc-e9e27daeae7f","Type":"ContainerStarted","Data":"98e71ac4a2c831dc07c39c9d08b4c799af1d39ab9d65b588adb9f6ff138f25e7"} Jul 17 17:50:06.343703 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:06.343652 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-52tzf" podStartSLOduration=10.887780995 podStartE2EDuration="40.343628078s" totalImagesPullingTime="29.455847083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:06.341616245 +0000 UTC m=+40.696467825" watchObservedRunningTime="2026-07-17 17:50:06.343628078 +0000 UTC m=+40.698479658" Jul 17 17:50:06.358239 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:06.358192 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vlhxt" podStartSLOduration=3.3144289909999998 podStartE2EDuration="6.358175797s" totalImagesPullingTime="3.043746806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:06.357657236 +0000 UTC m=+40.712508817" watchObservedRunningTime="2026-07-17 17:50:06.358175797 +0000 UTC m=+40.713027373" Jul 17 17:50:06.374841 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:06.374799 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-n7btl" podStartSLOduration=1.929747039 podStartE2EDuration="4.374782501s" totalImagesPullingTime="2.445035462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:06.373856265 +0000 UTC m=+40.728707844" watchObservedRunningTime="2026-07-17 17:50:06.374782501 +0000 UTC m=+40.729634080" Jul 17 17:50:08.764325 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:08.764284 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:08.764353 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:08.764383 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:08.764450 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:08.764470 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59c9569b7-wghnb: secret "image-registry-tls" not found Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:08.764494 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:08.764537 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls podName:0098fd6d-937a-4cfa-9068-a5fdd729cdb1 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:16.764518787 +0000 UTC m=+51.119370360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls") pod "image-registry-59c9569b7-wghnb" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1") : secret "image-registry-tls" not found Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:08.764556 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls podName:54f90a91-768c-4f1b-8740-4fd0eb7cf225 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:16.764543011 +0000 UTC m=+51.119394569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls") pod "insights-runtime-extractor-426kp" (UID: "54f90a91-768c-4f1b-8740-4fd0eb7cf225") : secret "insights-runtime-extractor-tls" not found Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:08.764573 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 17:50:08.764707 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:08.764638 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls podName:02f8f280-7e28-4ba5-a187-e36cd2d0d099 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:16.764615293 +0000 UTC m=+51.119466856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls") pod "dns-default-qchpg" (UID: "02f8f280-7e28-4ba5-a187-e36cd2d0d099") : secret "dns-default-metrics-tls" not found Jul 17 17:50:16.830406 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.830360 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:16.830406 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.830405 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:16.831045 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.830450 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:16.833658 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.833625 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02f8f280-7e28-4ba5-a187-e36cd2d0d099-metrics-tls\") pod \"dns-default-qchpg\" (UID: \"02f8f280-7e28-4ba5-a187-e36cd2d0d099\") " pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:16.833770 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.833726 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"image-registry-59c9569b7-wghnb\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:16.833770 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.833728 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54f90a91-768c-4f1b-8740-4fd0eb7cf225-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-426kp\" (UID: \"54f90a91-768c-4f1b-8740-4fd0eb7cf225\") " pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:16.851931 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.851903 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:16.864038 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.864001 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:16.883880 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:16.883828 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-426kp" Jul 17 17:50:17.047379 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.047324 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59c9569b7-wghnb"] Jul 17 17:50:17.050036 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:17.050005 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0098fd6d_937a_4cfa_9068_a5fdd729cdb1.slice/crio-5ab78788eef80b39bc90dad89ab950c79c39c58a6e7fc13715f7a581bc07b619 WatchSource:0}: Error finding container 5ab78788eef80b39bc90dad89ab950c79c39c58a6e7fc13715f7a581bc07b619: Status 404 returned error can't find the container with id 5ab78788eef80b39bc90dad89ab950c79c39c58a6e7fc13715f7a581bc07b619 Jul 17 17:50:17.067152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.067118 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qchpg"] Jul 17 17:50:17.069792 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:17.069760 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02f8f280_7e28_4ba5_a187_e36cd2d0d099.slice/crio-8009674e5880e354de206e7cfd46c06ad75245891e77e40f0be7d434b81f9eb2 WatchSource:0}: Error finding container 8009674e5880e354de206e7cfd46c06ad75245891e77e40f0be7d434b81f9eb2: Status 404 returned error can't find the container with id 8009674e5880e354de206e7cfd46c06ad75245891e77e40f0be7d434b81f9eb2 Jul 17 17:50:17.094511 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.094484 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-426kp"] Jul 17 17:50:17.096709 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:17.096682 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f90a91_768c_4f1b_8740_4fd0eb7cf225.slice/crio-60c1940c160f64809193895bd4c4535912115918321c58a688bed44626586fee WatchSource:0}: Error finding container 60c1940c160f64809193895bd4c4535912115918321c58a688bed44626586fee: Status 404 returned error can't find the container with id 60c1940c160f64809193895bd4c4535912115918321c58a688bed44626586fee Jul 17 17:50:17.349253 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.349161 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qchpg" event={"ID":"02f8f280-7e28-4ba5-a187-e36cd2d0d099","Type":"ContainerStarted","Data":"8009674e5880e354de206e7cfd46c06ad75245891e77e40f0be7d434b81f9eb2"} Jul 17 17:50:17.354739 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.354697 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-426kp" event={"ID":"54f90a91-768c-4f1b-8740-4fd0eb7cf225","Type":"ContainerStarted","Data":"60c1940c160f64809193895bd4c4535912115918321c58a688bed44626586fee"} Jul 17 17:50:17.356443 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.356405 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" event={"ID":"0098fd6d-937a-4cfa-9068-a5fdd729cdb1","Type":"ContainerStarted","Data":"69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081"} Jul 17 17:50:17.356443 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.356447 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" event={"ID":"0098fd6d-937a-4cfa-9068-a5fdd729cdb1","Type":"ContainerStarted","Data":"5ab78788eef80b39bc90dad89ab950c79c39c58a6e7fc13715f7a581bc07b619"} Jul 17 17:50:17.356700 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.356507 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:17.375512 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:17.375454 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" podStartSLOduration=38.375437622 podStartE2EDuration="38.375437622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:17.374668869 +0000 UTC m=+51.729520450" watchObservedRunningTime="2026-07-17 17:50:17.375437622 +0000 UTC m=+51.730289179" Jul 17 17:50:22.376393 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:22.376354 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qchpg" event={"ID":"02f8f280-7e28-4ba5-a187-e36cd2d0d099","Type":"ContainerStarted","Data":"f8e16803b74d90d267c7c09524bcb7ec6390d2f8dcb433abb85f0e45b55ff2a9"} Jul 17 17:50:22.376810 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:22.376441 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qchpg" event={"ID":"02f8f280-7e28-4ba5-a187-e36cd2d0d099","Type":"ContainerStarted","Data":"7f39c40859b4c9c582caf442375cbb8b937c23acc610ea9082db157297be2022"} Jul 17 17:50:22.376810 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:22.376499 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:22.378043 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:22.378006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-426kp" event={"ID":"54f90a91-768c-4f1b-8740-4fd0eb7cf225","Type":"ContainerStarted","Data":"d5dfce499af4ce351ef11d3c9e1c8ebbea56c1397baf96c90328ab80e387f339"} Jul 17 17:50:22.393359 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:22.393289 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qchpg" podStartSLOduration=19.987663479 podStartE2EDuration="22.39326579s" totalImagesPullingTime="2.405602311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:22.392077772 +0000 UTC m=+56.746929353" watchObservedRunningTime="2026-07-17 17:50:22.39326579 +0000 UTC m=+56.748117373" Jul 17 17:50:25.492829 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.492784 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c9569b7-wghnb"] Jul 17 17:50:25.500739 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.500705 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm"] Jul 17 17:50:25.592842 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.592803 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v"] Jul 17 17:50:25.593028 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.592962 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.596312 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.596285 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 17 17:50:25.596472 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.596343 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 17 17:50:25.596725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.596700 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 17 17:50:25.596907 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.596832 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 17 17:50:25.596992 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.596951 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xdggm\"" Jul 17 17:50:25.613285 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.613197 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf"] Jul 17 17:50:25.613285 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.613279 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.616055 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.616031 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 17 17:50:25.627968 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.627940 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf"] Jul 17 17:50:25.627968 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.627973 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm"] Jul 17 17:50:25.628137 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.627988 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v"] Jul 17 17:50:25.628137 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.628018 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-576bc9bd84-c6kb6"] Jul 17 17:50:25.628137 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.628060 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.631565 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.631536 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 17 17:50:25.631731 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.631713 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 17 17:50:25.631816 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.631769 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 17 17:50:25.631816 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.631777 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 17 17:50:25.650365 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.650328 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576bc9bd84-c6kb6"] Jul 17 17:50:25.650535 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.650461 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.706542 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706496 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1d0b725-9858-48d7-88cd-37e3cd705459-trusted-ca\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.706726 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706557 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh9px\" (UniqueName: \"kubernetes.io/projected/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-kube-api-access-fh9px\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.706726 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706632 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-bound-sa-token\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.706726 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706668 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g666\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-kube-api-access-9g666\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.706726 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1d0b725-9858-48d7-88cd-37e3cd705459-registry-certificates\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.706955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706751 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-ca\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.706955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706775 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13664b13-fea9-4c1d-afa2-5f26b2fde130-tmp\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.706955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706802 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/13664b13-fea9-4c1d-afa2-5f26b2fde130-klusterlet-config\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.706955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706889 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm\" (UID: \"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.706955 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706922 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.707220 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.706990 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.707220 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1d0b725-9858-48d7-88cd-37e3cd705459-image-registry-private-configuration\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.707220 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707038 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1d0b725-9858-48d7-88cd-37e3cd705459-ca-trust-extracted\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.707220 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1d0b725-9858-48d7-88cd-37e3cd705459-installation-pull-secrets\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.707220 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6nxl\" (UniqueName: \"kubernetes.io/projected/13664b13-fea9-4c1d-afa2-5f26b2fde130-kube-api-access-t6nxl\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.707220 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707182 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-824vh\" (UniqueName: \"kubernetes.io/projected/5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9-kube-api-access-824vh\") pod \"managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm\" (UID: \"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.707220 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707215 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.707500 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707243 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-registry-tls\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.707500 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.707269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-hub\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.808419 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808381 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/13664b13-fea9-4c1d-afa2-5f26b2fde130-klusterlet-config\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.808419 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808426 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm\" (UID: \"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808446 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808493 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808512 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1d0b725-9858-48d7-88cd-37e3cd705459-image-registry-private-configuration\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808549 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1d0b725-9858-48d7-88cd-37e3cd705459-ca-trust-extracted\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808578 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1d0b725-9858-48d7-88cd-37e3cd705459-installation-pull-secrets\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808627 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6nxl\" (UniqueName: \"kubernetes.io/projected/13664b13-fea9-4c1d-afa2-5f26b2fde130-kube-api-access-t6nxl\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808653 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-824vh\" (UniqueName: \"kubernetes.io/projected/5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9-kube-api-access-824vh\") pod \"managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm\" (UID: \"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.808696 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808681 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808708 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-registry-tls\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808732 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-hub\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1d0b725-9858-48d7-88cd-37e3cd705459-trusted-ca\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808801 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh9px\" (UniqueName: \"kubernetes.io/projected/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-kube-api-access-fh9px\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-bound-sa-token\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808850 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g666\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-kube-api-access-9g666\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808917 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1d0b725-9858-48d7-88cd-37e3cd705459-registry-certificates\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808949 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-ca\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.808974 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13664b13-fea9-4c1d-afa2-5f26b2fde130-tmp\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.809177 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.809038 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e1d0b725-9858-48d7-88cd-37e3cd705459-ca-trust-extracted\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.809818 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.809306 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13664b13-fea9-4c1d-afa2-5f26b2fde130-tmp\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.810997 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.810474 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e1d0b725-9858-48d7-88cd-37e3cd705459-registry-certificates\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.810997 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.810845 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e1d0b725-9858-48d7-88cd-37e3cd705459-trusted-ca\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.811506 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.811476 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.811884 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.811840 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e1d0b725-9858-48d7-88cd-37e3cd705459-image-registry-private-configuration\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.812248 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.812227 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/13664b13-fea9-4c1d-afa2-5f26b2fde130-klusterlet-config\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.813079 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.813001 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.813196 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.813164 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-hub\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.813832 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.813649 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.813832 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.813767 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e1d0b725-9858-48d7-88cd-37e3cd705459-installation-pull-secrets\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.814373 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.814343 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm\" (UID: \"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.814452 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.814434 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-registry-tls\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.814759 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.814739 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-ca\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.819542 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.819466 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-bound-sa-token\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.819825 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.819785 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6nxl\" (UniqueName: \"kubernetes.io/projected/13664b13-fea9-4c1d-afa2-5f26b2fde130-kube-api-access-t6nxl\") pod \"klusterlet-addon-workmgr-bc9945d4d-vkm6v\" (UID: \"13664b13-fea9-4c1d-afa2-5f26b2fde130\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.819934 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.819838 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g666\" (UniqueName: \"kubernetes.io/projected/e1d0b725-9858-48d7-88cd-37e3cd705459-kube-api-access-9g666\") pod \"image-registry-576bc9bd84-c6kb6\" (UID: \"e1d0b725-9858-48d7-88cd-37e3cd705459\") " pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:25.820350 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.820316 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-824vh\" (UniqueName: \"kubernetes.io/projected/5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9-kube-api-access-824vh\") pod \"managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm\" (UID: \"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.820350 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.820336 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh9px\" (UniqueName: \"kubernetes.io/projected/e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd-kube-api-access-fh9px\") pod \"cluster-proxy-proxy-agent-7866f4c679-nb6pf\" (UID: \"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.910582 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.910550 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" Jul 17 17:50:25.923777 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.923749 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:25.937793 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.937759 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" Jul 17 17:50:25.968938 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:25.968897 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:26.079944 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.079916 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm"] Jul 17 17:50:26.103579 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.103546 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v"] Jul 17 17:50:26.125450 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.125420 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf"] Jul 17 17:50:26.207695 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:26.207650 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5332eaa7_9f51_4cf1_a6e3_d2a542aac0d9.slice/crio-3f3b45aa044239da688ca8d5570ff8be9d5eb8a4b5ccf103bd484c48a1e0c42d WatchSource:0}: Error finding container 3f3b45aa044239da688ca8d5570ff8be9d5eb8a4b5ccf103bd484c48a1e0c42d: Status 404 returned error can't find the container with id 3f3b45aa044239da688ca8d5570ff8be9d5eb8a4b5ccf103bd484c48a1e0c42d Jul 17 17:50:26.208168 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:26.208127 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13664b13_fea9_4c1d_afa2_5f26b2fde130.slice/crio-d108eb3109cc5a884e1ed6664dca61ade033b0111772a721dc94cfee07821b6f WatchSource:0}: Error finding container d108eb3109cc5a884e1ed6664dca61ade033b0111772a721dc94cfee07821b6f: Status 404 returned error can't find the container with id d108eb3109cc5a884e1ed6664dca61ade033b0111772a721dc94cfee07821b6f Jul 17 17:50:26.209047 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:26.208933 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7c07144_97a2_408d_a3a3_8d3a6d9a4ddd.slice/crio-39a82cb7643035502132a5b75b86cc9e1f9510b56a8faa1e2e9a129220fb592e WatchSource:0}: Error finding container 39a82cb7643035502132a5b75b86cc9e1f9510b56a8faa1e2e9a129220fb592e: Status 404 returned error can't find the container with id 39a82cb7643035502132a5b75b86cc9e1f9510b56a8faa1e2e9a129220fb592e Jul 17 17:50:26.368822 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.368787 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-576bc9bd84-c6kb6"] Jul 17 17:50:26.372594 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:26.372557 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d0b725_9858_48d7_88cd_37e3cd705459.slice/crio-a137151ba9ef422369fb46041860c2c22abb8e6311f8b7efe88830379002b6d3 WatchSource:0}: Error finding container a137151ba9ef422369fb46041860c2c22abb8e6311f8b7efe88830379002b6d3: Status 404 returned error can't find the container with id a137151ba9ef422369fb46041860c2c22abb8e6311f8b7efe88830379002b6d3 Jul 17 17:50:26.392352 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.392301 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" event={"ID":"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd","Type":"ContainerStarted","Data":"39a82cb7643035502132a5b75b86cc9e1f9510b56a8faa1e2e9a129220fb592e"} Jul 17 17:50:26.393981 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.393953 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-426kp" event={"ID":"54f90a91-768c-4f1b-8740-4fd0eb7cf225","Type":"ContainerStarted","Data":"98ec2f4f6cc698fc6b768d379443a0869616af120025eaeac62f1ef31b3fff70"} Jul 17 17:50:26.395224 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.395192 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" event={"ID":"e1d0b725-9858-48d7-88cd-37e3cd705459","Type":"ContainerStarted","Data":"a137151ba9ef422369fb46041860c2c22abb8e6311f8b7efe88830379002b6d3"} Jul 17 17:50:26.396313 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.396288 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" event={"ID":"13664b13-fea9-4c1d-afa2-5f26b2fde130","Type":"ContainerStarted","Data":"d108eb3109cc5a884e1ed6664dca61ade033b0111772a721dc94cfee07821b6f"} Jul 17 17:50:26.397433 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:26.397413 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" event={"ID":"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9","Type":"ContainerStarted","Data":"3f3b45aa044239da688ca8d5570ff8be9d5eb8a4b5ccf103bd484c48a1e0c42d"} Jul 17 17:50:27.290958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:27.290924 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-btzx5" Jul 17 17:50:27.409238 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:27.409195 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" event={"ID":"e1d0b725-9858-48d7-88cd-37e3cd705459","Type":"ContainerStarted","Data":"1d880c6d5a7e07b015267c2f71be45908de1348056c6ae7a1409d08d3aff5dad"} Jul 17 17:50:27.410031 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:27.410008 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:27.458705 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:27.458638 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" podStartSLOduration=2.458613014 podStartE2EDuration="2.458613014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:27.454138537 +0000 UTC m=+61.808990118" watchObservedRunningTime="2026-07-17 17:50:27.458613014 +0000 UTC m=+61.813464596" Jul 17 17:50:31.873345 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.873293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:50:31.873345 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.873347 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:50:31.876141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.876116 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 17:50:31.876275 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.876116 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 17:50:31.887102 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.887068 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/293c10fa-e12e-4eae-a937-5a2f26cac6d7-original-pull-secret\") pod \"global-pull-secret-syncer-5vt46\" (UID: \"293c10fa-e12e-4eae-a937-5a2f26cac6d7\") " pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:50:31.887255 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.887133 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 17:50:31.898332 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.898300 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql2nx\" (UniqueName: \"kubernetes.io/projected/6f7d9efa-2c21-4519-a32e-61cd3eb09f3d-kube-api-access-ql2nx\") pod \"network-check-target-z6h6q\" (UID: \"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d\") " pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:50:31.974545 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.974488 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:50:31.977469 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.977447 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 17:50:31.988291 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:31.988259 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5954494-0d8d-49e0-83bd-c538159c1142-metrics-certs\") pod \"network-metrics-daemon-krdns\" (UID: \"f5954494-0d8d-49e0-83bd-c538159c1142\") " pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:50:32.032285 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:32.032234 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5vt46" Jul 17 17:50:32.041910 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:32.041876 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nlkcj\"" Jul 17 17:50:32.048735 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:32.048705 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xgrcl\"" Jul 17 17:50:32.049706 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:32.049685 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:50:32.056587 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:32.056556 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-krdns" Jul 17 17:50:32.383805 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:32.383777 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qchpg" Jul 17 17:50:35.084672 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.084645 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z6h6q"] Jul 17 17:50:35.112104 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.112072 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5vt46"] Jul 17 17:50:35.115158 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:35.115124 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod293c10fa_e12e_4eae_a937_5a2f26cac6d7.slice/crio-16949c564d7c5f1e72e247525b12efb4f6a60248c7103f4b0c864daf2dd9a125 WatchSource:0}: Error finding container 16949c564d7c5f1e72e247525b12efb4f6a60248c7103f4b0c864daf2dd9a125: Status 404 returned error can't find the container with id 16949c564d7c5f1e72e247525b12efb4f6a60248c7103f4b0c864daf2dd9a125 Jul 17 17:50:35.129985 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.128909 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-krdns"] Jul 17 17:50:35.448158 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.448059 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krdns" event={"ID":"f5954494-0d8d-49e0-83bd-c538159c1142","Type":"ContainerStarted","Data":"307b80a8a3f981e30338c2f9bc9c35e7c2254ad76c9274bfbd8d5f5a90f40a3b"} Jul 17 17:50:35.450259 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.450221 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" event={"ID":"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd","Type":"ContainerStarted","Data":"b32ecca80e56bfe78b930ac7476e53f7f8bd2a03f2156f1814bf5f244820959e"} Jul 17 17:50:35.450392 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.450276 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" event={"ID":"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd","Type":"ContainerStarted","Data":"d9ab259af93094dc28575d451e6519f079399fbd5e065e6542ae943ed848c043"} Jul 17 17:50:35.450392 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.450297 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" event={"ID":"e7c07144-97a2-408d-a3a3-8d3a6d9a4ddd","Type":"ContainerStarted","Data":"4d1c5102367e8947112bbeafb5c5a407bca327057a9c271b2ee4b2af285124a6"} Jul 17 17:50:35.452527 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.452484 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-426kp" event={"ID":"54f90a91-768c-4f1b-8740-4fd0eb7cf225","Type":"ContainerStarted","Data":"de98f06a5282fa684c9820f37d5c631ce695dab486fd60ddca41b3696c672ced"} Jul 17 17:50:35.454028 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.454001 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" event={"ID":"13664b13-fea9-4c1d-afa2-5f26b2fde130","Type":"ContainerStarted","Data":"6965b034c8f8b7e14a5edcb810d2238f8459aea6e7b16a53a3d0099c024dc2f8"} Jul 17 17:50:35.454242 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.454191 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:35.455604 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.455570 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" event={"ID":"5332eaa7-9f51-4cf1-a6e3-d2a542aac0d9","Type":"ContainerStarted","Data":"e734f94bd57c422e6613450f5a333bd6fd32d0d690c3ba37e6b90e45ebdcd8bc"} Jul 17 17:50:35.456251 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.456223 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" Jul 17 17:50:35.456925 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.456901 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vt46" event={"ID":"293c10fa-e12e-4eae-a937-5a2f26cac6d7","Type":"ContainerStarted","Data":"16949c564d7c5f1e72e247525b12efb4f6a60248c7103f4b0c864daf2dd9a125"} Jul 17 17:50:35.458189 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.458165 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6h6q" event={"ID":"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d","Type":"ContainerStarted","Data":"975d261ecf7adaf34b6a6aace98682354791069abb569d695a4b4d6f96e927aa"} Jul 17 17:50:35.469746 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.469698 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7866f4c679-nb6pf" podStartSLOduration=1.763012933 podStartE2EDuration="10.469685267s" totalImagesPullingTime="8.706672334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:35.46870641 +0000 UTC m=+69.823557990" watchObservedRunningTime="2026-07-17 17:50:35.469685267 +0000 UTC m=+69.824536824" Jul 17 17:50:35.489716 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.489662 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-426kp" podStartSLOduration=17.873809786 podStartE2EDuration="35.489646202s" totalImagesPullingTime="17.615836416s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:50:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:35.488710994 +0000 UTC m=+69.843562586" watchObservedRunningTime="2026-07-17 17:50:35.489646202 +0000 UTC m=+69.844497782" Jul 17 17:50:35.499451 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.499416 2552 patch_prober.go:28] interesting pod/image-registry-59c9569b7-wghnb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 17 17:50:35.499613 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.499479 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" podUID="0098fd6d-937a-4cfa-9068-a5fdd729cdb1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:50:35.505357 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.505310 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bc9945d4d-vkm6v" podStartSLOduration=1.810680469 podStartE2EDuration="10.505293386s" totalImagesPullingTime="8.694612917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:35.504581461 +0000 UTC m=+69.859433041" watchObservedRunningTime="2026-07-17 17:50:35.505293386 +0000 UTC m=+69.860144999" Jul 17 17:50:35.523171 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:35.523111 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6b45bbb6-wfckm" podStartSLOduration=1.827637913 podStartE2EDuration="10.523090714s" totalImagesPullingTime="8.695452801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:35.521987976 +0000 UTC m=+69.876839557" watchObservedRunningTime="2026-07-17 17:50:35.523090714 +0000 UTC m=+69.877942293" Jul 17 17:50:37.471491 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:37.471450 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krdns" event={"ID":"f5954494-0d8d-49e0-83bd-c538159c1142","Type":"ContainerStarted","Data":"fd93a420deea4f355d09253873b40f48022cf4406dbf63a5df1b197f6c6adea0"} Jul 17 17:50:37.471963 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:37.471547 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-krdns" event={"ID":"f5954494-0d8d-49e0-83bd-c538159c1142","Type":"ContainerStarted","Data":"abf8e3443f8800293919fb88a198c107d59b5530de0b548373e5d6f54020596a"} Jul 17 17:50:37.488225 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:37.488156 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-krdns" podStartSLOduration=70.016938856 podStartE2EDuration="1m11.488099679s" totalImagesPullingTime="1.471160823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:37.486798108 +0000 UTC m=+71.841649690" watchObservedRunningTime="2026-07-17 17:50:37.488099679 +0000 UTC m=+71.842951262" Jul 17 17:50:40.483603 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:40.483556 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5vt46" event={"ID":"293c10fa-e12e-4eae-a937-5a2f26cac6d7","Type":"ContainerStarted","Data":"b39a8a38013c53d88b2fac36d66491eca246a971d86a28a66735713fedf59f28"} Jul 17 17:50:40.485066 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:40.485039 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z6h6q" event={"ID":"6f7d9efa-2c21-4519-a32e-61cd3eb09f3d","Type":"ContainerStarted","Data":"53509b2fe674e89b248cc9b48b5d1cfdb61252abad279c220887154e1a083183"} Jul 17 17:50:40.485135 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:40.485104 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:50:40.499174 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:40.499123 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5vt46" podStartSLOduration=69.883000089 podStartE2EDuration="1m14.499106047s" totalImagesPullingTime="4.616105958s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:40.498567194 +0000 UTC m=+74.853418775" watchObservedRunningTime="2026-07-17 17:50:40.499106047 +0000 UTC m=+74.853957626" Jul 17 17:50:40.512974 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:40.512928 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z6h6q" podStartSLOduration=69.879116764 podStartE2EDuration="1m14.512913545s" totalImagesPullingTime="4.633796781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:40.512587426 +0000 UTC m=+74.867439006" watchObservedRunningTime="2026-07-17 17:50:40.512913545 +0000 UTC m=+74.867765160" Jul 17 17:50:43.638426 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.638391 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gz4bq"] Jul 17 17:50:43.640977 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.640956 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.644041 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.644003 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 17:50:43.644182 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.644053 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kp4nt\"" Jul 17 17:50:43.644330 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.644314 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 17:50:43.644532 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.644510 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 17:50:43.645156 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.645139 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 17:50:43.645242 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.645150 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 17:50:43.645242 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.645160 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 17:50:43.767150 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767360 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767160 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fhcp\" (UniqueName: \"kubernetes.io/projected/8f6dd0d9-b59b-47fa-b868-c5328a981449-kube-api-access-4fhcp\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767360 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-tls\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767360 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767217 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6dd0d9-b59b-47fa-b868-c5328a981449-metrics-client-ca\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767360 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767255 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-textfile\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767360 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-wtmp\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767360 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767318 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-accelerators-collector-config\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767609 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767406 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-sys\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.767609 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.767450 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-root\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868303 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868258 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868303 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868309 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fhcp\" (UniqueName: \"kubernetes.io/projected/8f6dd0d9-b59b-47fa-b868-c5328a981449-kube-api-access-4fhcp\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868341 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-tls\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868369 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6dd0d9-b59b-47fa-b868-c5328a981449-metrics-client-ca\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-textfile\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868443 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-wtmp\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868469 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-accelerators-collector-config\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868519 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-sys\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868540 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-root\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.868917 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.868615 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-root\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.869609 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.869095 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-sys\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.869609 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.869113 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-textfile\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.869609 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:43.869206 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 17:50:43.869609 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.869251 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-wtmp\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.869609 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:43.869266 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-tls podName:8f6dd0d9-b59b-47fa-b868-c5328a981449 nodeName:}" failed. No retries permitted until 2026-07-17 17:50:44.369245848 +0000 UTC m=+78.724097419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-tls") pod "node-exporter-gz4bq" (UID: "8f6dd0d9-b59b-47fa-b868-c5328a981449") : secret "node-exporter-tls" not found Jul 17 17:50:43.869609 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.869557 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-accelerators-collector-config\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.869942 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.869688 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f6dd0d9-b59b-47fa-b868-c5328a981449-metrics-client-ca\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.871187 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.871164 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:43.880880 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:43.880835 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fhcp\" (UniqueName: \"kubernetes.io/projected/8f6dd0d9-b59b-47fa-b868-c5328a981449-kube-api-access-4fhcp\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:44.374074 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:44.374030 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-tls\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:44.376939 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:44.376901 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8f6dd0d9-b59b-47fa-b868-c5328a981449-node-exporter-tls\") pod \"node-exporter-gz4bq\" (UID: \"8f6dd0d9-b59b-47fa-b868-c5328a981449\") " pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:44.550707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:44.550666 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gz4bq" Jul 17 17:50:44.564542 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:50:44.563278 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f6dd0d9_b59b_47fa_b868_c5328a981449.slice/crio-44ed565cab27ab05668b3572c1a19d3347661a5acc162cd1859dab618f46e8c1 WatchSource:0}: Error finding container 44ed565cab27ab05668b3572c1a19d3347661a5acc162cd1859dab618f46e8c1: Status 404 returned error can't find the container with id 44ed565cab27ab05668b3572c1a19d3347661a5acc162cd1859dab618f46e8c1 Jul 17 17:50:45.498727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:45.498700 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:45.504524 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:45.504492 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gz4bq" event={"ID":"8f6dd0d9-b59b-47fa-b868-c5328a981449","Type":"ContainerStarted","Data":"c9f065fee1eb2d507ed964edfed389c1dbb11acae4446d54adcc1d1d10f58c33"} Jul 17 17:50:45.504675 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:45.504549 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gz4bq" event={"ID":"8f6dd0d9-b59b-47fa-b868-c5328a981449","Type":"ContainerStarted","Data":"44ed565cab27ab05668b3572c1a19d3347661a5acc162cd1859dab618f46e8c1"} Jul 17 17:50:46.509206 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:46.509170 2552 generic.go:356] "Generic (PLEG): container finished" podID="8f6dd0d9-b59b-47fa-b868-c5328a981449" containerID="c9f065fee1eb2d507ed964edfed389c1dbb11acae4446d54adcc1d1d10f58c33" exitCode=0 Jul 17 17:50:46.509612 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:46.509246 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gz4bq" event={"ID":"8f6dd0d9-b59b-47fa-b868-c5328a981449","Type":"ContainerDied","Data":"c9f065fee1eb2d507ed964edfed389c1dbb11acae4446d54adcc1d1d10f58c33"} Jul 17 17:50:47.515563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:47.515445 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gz4bq" event={"ID":"8f6dd0d9-b59b-47fa-b868-c5328a981449","Type":"ContainerStarted","Data":"953e70d390057b8b8d91eff557f4592863353db99cfc7d5768bd60d414dbe9b7"} Jul 17 17:50:47.515563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:47.515501 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gz4bq" event={"ID":"8f6dd0d9-b59b-47fa-b868-c5328a981449","Type":"ContainerStarted","Data":"737f42c5a4c52d3f85e4ec33b6678bf18cae8dee783c10b49d1dae9a57875e85"} Jul 17 17:50:47.537743 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:47.537686 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gz4bq" podStartSLOduration=3.642959126 podStartE2EDuration="4.537669583s" totalImagesPullingTime="821.027264ms" totalInitContainerRuntime="73.683193ms" isStatefulPod=true podCreationTimestamp="2026-07-17 17:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:50:47.535989351 +0000 UTC m=+81.890840931" watchObservedRunningTime="2026-07-17 17:50:47.537669583 +0000 UTC m=+81.892521165" Jul 17 17:50:49.429915 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:49.429882 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-576bc9bd84-c6kb6" Jul 17 17:50:50.514439 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.514394 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" podUID="0098fd6d-937a-4cfa-9068-a5fdd729cdb1" containerName="registry" containerID="cri-o://69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081" gracePeriod=30 Jul 17 17:50:50.757149 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.757123 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:50.941511 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941411 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-ca-trust-extracted\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.941511 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941457 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-trusted-ca\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.941511 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941475 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-certificates\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.941511 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941498 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-installation-pull-secrets\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.941826 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941526 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-image-registry-private-configuration\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.941826 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941548 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-bound-sa-token\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.941826 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941582 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zwml\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-kube-api-access-4zwml\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.941826 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941615 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") pod \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\" (UID: \"0098fd6d-937a-4cfa-9068-a5fdd729cdb1\") " Jul 17 17:50:50.942074 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941963 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:50:50.942074 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.941986 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:50:50.944325 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.944292 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:50:50.944495 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.944398 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:50:50.944709 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.944685 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:50:50.944772 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.944742 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-kube-api-access-4zwml" (OuterVolumeSpecName: "kube-api-access-4zwml") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "kube-api-access-4zwml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:50:50.944844 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.944824 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:50:50.950590 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:50.950563 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0098fd6d-937a-4cfa-9068-a5fdd729cdb1" (UID: "0098fd6d-937a-4cfa-9068-a5fdd729cdb1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:50:51.042493 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042434 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-image-registry-private-configuration\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.042493 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042483 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-bound-sa-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.042493 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042494 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zwml\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-kube-api-access-4zwml\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.042493 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042503 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-tls\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.042493 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042512 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-ca-trust-extracted\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.042801 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042520 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-trusted-ca\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.042801 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042528 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-registry-certificates\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.042801 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.042535 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0098fd6d-937a-4cfa-9068-a5fdd729cdb1-installation-pull-secrets\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:50:51.530317 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.530273 2552 generic.go:356] "Generic (PLEG): container finished" podID="0098fd6d-937a-4cfa-9068-a5fdd729cdb1" containerID="69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081" exitCode=0 Jul 17 17:50:51.530689 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.530334 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" Jul 17 17:50:51.530689 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.530354 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" event={"ID":"0098fd6d-937a-4cfa-9068-a5fdd729cdb1","Type":"ContainerDied","Data":"69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081"} Jul 17 17:50:51.530689 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.530408 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59c9569b7-wghnb" event={"ID":"0098fd6d-937a-4cfa-9068-a5fdd729cdb1","Type":"ContainerDied","Data":"5ab78788eef80b39bc90dad89ab950c79c39c58a6e7fc13715f7a581bc07b619"} Jul 17 17:50:51.531112 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.531098 2552 scope.go:117] "RemoveContainer" containerID="69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081" Jul 17 17:50:51.539595 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.539579 2552 scope.go:117] "RemoveContainer" containerID="69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081" Jul 17 17:50:51.539933 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:50:51.539912 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081\": container with ID starting with 69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081 not found: ID does not exist" containerID="69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081" Jul 17 17:50:51.539979 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.539945 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081"} err="failed to get container status \"69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081\": rpc error: code = NotFound desc = could not find container \"69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081\": container with ID starting with 69cd89b3c77eb41bf0dbda644993b4a4ad1b9e22b4d13a58a61d1b180a097081 not found: ID does not exist" Jul 17 17:50:51.552836 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.552802 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59c9569b7-wghnb"] Jul 17 17:50:51.556579 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:51.556555 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59c9569b7-wghnb"] Jul 17 17:50:52.125812 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:50:52.125767 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0098fd6d-937a-4cfa-9068-a5fdd729cdb1" path="/var/lib/kubelet/pods/0098fd6d-937a-4cfa-9068-a5fdd729cdb1/volumes" Jul 17 17:51:11.491487 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:51:11.491452 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z6h6q" Jul 17 17:54:16.013524 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.013487 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5"] Jul 17 17:54:16.013972 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.013778 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0098fd6d-937a-4cfa-9068-a5fdd729cdb1" containerName="registry" Jul 17 17:54:16.013972 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.013790 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="0098fd6d-937a-4cfa-9068-a5fdd729cdb1" containerName="registry" Jul 17 17:54:16.013972 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.013831 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="0098fd6d-937a-4cfa-9068-a5fdd729cdb1" containerName="registry" Jul 17 17:54:16.015727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.015711 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.018885 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.018843 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 17 17:54:16.019017 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.018898 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 17 17:54:16.019017 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.018931 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xc9bm\"" Jul 17 17:54:16.019017 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.018952 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 17 17:54:16.019337 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.019324 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 17 17:54:16.032908 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.032881 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5"] Jul 17 17:54:16.099089 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.099055 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qzhw\" (UniqueName: \"kubernetes.io/projected/c22a27ae-df66-494d-a321-34afd5e7a187-kube-api-access-5qzhw\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.099089 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.099092 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22a27ae-df66-494d-a321-34afd5e7a187-tmp\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.099310 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.099124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c22a27ae-df66-494d-a321-34afd5e7a187-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.099310 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.099209 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c22a27ae-df66-494d-a321-34afd5e7a187-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.099310 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.099250 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c22a27ae-df66-494d-a321-34afd5e7a187-manifests\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.199824 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.199790 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c22a27ae-df66-494d-a321-34afd5e7a187-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.199824 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.199830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c22a27ae-df66-494d-a321-34afd5e7a187-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.200134 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.199855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c22a27ae-df66-494d-a321-34afd5e7a187-manifests\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.200134 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.199931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qzhw\" (UniqueName: \"kubernetes.io/projected/c22a27ae-df66-494d-a321-34afd5e7a187-kube-api-access-5qzhw\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.200134 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.199953 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22a27ae-df66-494d-a321-34afd5e7a187-tmp\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.200372 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.200343 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c22a27ae-df66-494d-a321-34afd5e7a187-manifests\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.202404 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.202376 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c22a27ae-df66-494d-a321-34afd5e7a187-tmp\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.202608 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.202587 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c22a27ae-df66-494d-a321-34afd5e7a187-apiservice-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.202656 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.202635 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c22a27ae-df66-494d-a321-34afd5e7a187-webhook-cert\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.213958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.213932 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qzhw\" (UniqueName: \"kubernetes.io/projected/c22a27ae-df66-494d-a321-34afd5e7a187-kube-api-access-5qzhw\") pod \"opendatahub-operator-controller-manager-cc99fdf4f-v2zc5\" (UID: \"c22a27ae-df66-494d-a321-34afd5e7a187\") " pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.325301 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.325204 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:16.459818 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:16.459788 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5"] Jul 17 17:54:16.462738 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:16.462708 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc22a27ae_df66_494d_a321_34afd5e7a187.slice/crio-b002f674f996f88f574c64a51e2ab694f08a71cc823415a8ebdfa8a042e6cca1 WatchSource:0}: Error finding container b002f674f996f88f574c64a51e2ab694f08a71cc823415a8ebdfa8a042e6cca1: Status 404 returned error can't find the container with id b002f674f996f88f574c64a51e2ab694f08a71cc823415a8ebdfa8a042e6cca1 Jul 17 17:54:17.222820 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:17.222782 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" event={"ID":"c22a27ae-df66-494d-a321-34afd5e7a187","Type":"ContainerStarted","Data":"b002f674f996f88f574c64a51e2ab694f08a71cc823415a8ebdfa8a042e6cca1"} Jul 17 17:54:20.235966 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:20.235929 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" event={"ID":"c22a27ae-df66-494d-a321-34afd5e7a187","Type":"ContainerStarted","Data":"61073c8ebb5dc7eb4ae48680559f3c6699c82e94842bf2eb2ffe71d1ce9dd962"} Jul 17 17:54:21.241415 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:21.241374 2552 generic.go:356] "Generic (PLEG): container finished" podID="c22a27ae-df66-494d-a321-34afd5e7a187" containerID="61073c8ebb5dc7eb4ae48680559f3c6699c82e94842bf2eb2ffe71d1ce9dd962" exitCode=0 Jul 17 17:54:21.241925 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:21.241444 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" event={"ID":"c22a27ae-df66-494d-a321-34afd5e7a187","Type":"ContainerDied","Data":"61073c8ebb5dc7eb4ae48680559f3c6699c82e94842bf2eb2ffe71d1ce9dd962"} Jul 17 17:54:22.247247 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:22.247210 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" event={"ID":"c22a27ae-df66-494d-a321-34afd5e7a187","Type":"ContainerStarted","Data":"3b17454fc465aef037600c3f03f26ea16dbf5832ac8ad59823ef687affe36433"} Jul 17 17:54:22.247637 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:22.247343 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:22.303205 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:22.303147 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" podStartSLOduration=3.004283113 podStartE2EDuration="7.303128021s" totalImagesPullingTime="3.275755451s" totalInitContainerRuntime="1.023089457s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:22.300595209 +0000 UTC m=+296.655446789" watchObservedRunningTime="2026-07-17 17:54:22.303128021 +0000 UTC m=+296.657979660" Jul 17 17:54:26.032831 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:26.032801 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 17:54:33.251997 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:33.251960 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-cc99fdf4f-v2zc5" Jul 17 17:54:35.575448 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.575410 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt"] Jul 17 17:54:35.577364 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.577346 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.580292 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.580271 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 17 17:54:35.581724 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.581700 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 17:54:35.581847 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.581726 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2hlm6\"" Jul 17 17:54:35.581847 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.581727 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 17 17:54:35.581847 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.581727 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 17:54:35.590136 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.590107 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt"] Jul 17 17:54:35.735631 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.735594 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hn2x"] Jul 17 17:54:35.738219 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.738198 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:35.741574 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.741555 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-k2lbc\"" Jul 17 17:54:35.741822 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.741805 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 17 17:54:35.748456 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.748431 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9b4441-bd66-49b4-abb5-7e9402abf206-tls-certs\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.748585 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.748460 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad9b4441-bd66-49b4-abb5-7e9402abf206-tmp\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.748585 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.748491 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb42h\" (UniqueName: \"kubernetes.io/projected/ad9b4441-bd66-49b4-abb5-7e9402abf206-kube-api-access-bb42h\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.753476 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.753442 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hn2x"] Jul 17 17:54:35.849884 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.849768 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb42h\" (UniqueName: \"kubernetes.io/projected/ad9b4441-bd66-49b4-abb5-7e9402abf206-kube-api-access-bb42h\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.849884 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.849834 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-cert\") pod \"odh-model-controller-7998c67dc4-2hn2x\" (UID: \"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:35.850124 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.849885 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgqt2\" (UniqueName: \"kubernetes.io/projected/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-kube-api-access-hgqt2\") pod \"odh-model-controller-7998c67dc4-2hn2x\" (UID: \"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:35.850124 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.849917 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9b4441-bd66-49b4-abb5-7e9402abf206-tls-certs\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.850124 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.849940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad9b4441-bd66-49b4-abb5-7e9402abf206-tmp\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.852257 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.852235 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ad9b4441-bd66-49b4-abb5-7e9402abf206-tmp\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.852544 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.852524 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad9b4441-bd66-49b4-abb5-7e9402abf206-tls-certs\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.859933 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.859900 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb42h\" (UniqueName: \"kubernetes.io/projected/ad9b4441-bd66-49b4-abb5-7e9402abf206-kube-api-access-bb42h\") pod \"kube-auth-proxy-6799b9db4b-k46vt\" (UID: \"ad9b4441-bd66-49b4-abb5-7e9402abf206\") " pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.886621 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.886582 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" Jul 17 17:54:35.951624 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.951112 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-cert\") pod \"odh-model-controller-7998c67dc4-2hn2x\" (UID: \"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:35.951624 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.951189 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgqt2\" (UniqueName: \"kubernetes.io/projected/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-kube-api-access-hgqt2\") pod \"odh-model-controller-7998c67dc4-2hn2x\" (UID: \"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:35.951881 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:54:35.951673 2552 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 17 17:54:35.951881 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:54:35.951768 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-cert podName:6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51 nodeName:}" failed. No retries permitted until 2026-07-17 17:54:36.451735876 +0000 UTC m=+310.806587447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-cert") pod "odh-model-controller-7998c67dc4-2hn2x" (UID: "6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51") : secret "odh-model-controller-webhook-cert" not found Jul 17 17:54:35.963009 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:35.962982 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgqt2\" (UniqueName: \"kubernetes.io/projected/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-kube-api-access-hgqt2\") pod \"odh-model-controller-7998c67dc4-2hn2x\" (UID: \"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:36.030744 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.030690 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt"] Jul 17 17:54:36.033787 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:36.033745 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9b4441_bd66_49b4_abb5_7e9402abf206.slice/crio-a35dd8ef1ca9e52104d8ca6fbfc836c2b4532a2655f7dc0912a4b596ac6ce5c9 WatchSource:0}: Error finding container a35dd8ef1ca9e52104d8ca6fbfc836c2b4532a2655f7dc0912a4b596ac6ce5c9: Status 404 returned error can't find the container with id a35dd8ef1ca9e52104d8ca6fbfc836c2b4532a2655f7dc0912a4b596ac6ce5c9 Jul 17 17:54:36.035647 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.035632 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:54:36.218621 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.218528 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wkt5h"] Jul 17 17:54:36.221182 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.221157 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.224418 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.224399 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 17 17:54:36.246045 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.245995 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wkt5h"] Jul 17 17:54:36.295637 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.295591 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" event={"ID":"ad9b4441-bd66-49b4-abb5-7e9402abf206","Type":"ContainerStarted","Data":"a35dd8ef1ca9e52104d8ca6fbfc836c2b4532a2655f7dc0912a4b596ac6ce5c9"} Jul 17 17:54:36.354417 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.354383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrxtr\" (UniqueName: \"kubernetes.io/projected/87a0829b-2c60-4132-be07-8bd3277129b5-kube-api-access-xrxtr\") pod \"model-serving-api-54d89bd5fc-wkt5h\" (UID: \"87a0829b-2c60-4132-be07-8bd3277129b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.354595 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.354424 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87a0829b-2c60-4132-be07-8bd3277129b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-wkt5h\" (UID: \"87a0829b-2c60-4132-be07-8bd3277129b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.455276 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.455243 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-cert\") pod \"odh-model-controller-7998c67dc4-2hn2x\" (UID: \"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:36.455466 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.455294 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrxtr\" (UniqueName: \"kubernetes.io/projected/87a0829b-2c60-4132-be07-8bd3277129b5-kube-api-access-xrxtr\") pod \"model-serving-api-54d89bd5fc-wkt5h\" (UID: \"87a0829b-2c60-4132-be07-8bd3277129b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.455466 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.455316 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87a0829b-2c60-4132-be07-8bd3277129b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-wkt5h\" (UID: \"87a0829b-2c60-4132-be07-8bd3277129b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.458060 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.458032 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87a0829b-2c60-4132-be07-8bd3277129b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-wkt5h\" (UID: \"87a0829b-2c60-4132-be07-8bd3277129b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.458162 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.458032 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51-cert\") pod \"odh-model-controller-7998c67dc4-2hn2x\" (UID: \"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51\") " pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:36.474990 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.474920 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrxtr\" (UniqueName: \"kubernetes.io/projected/87a0829b-2c60-4132-be07-8bd3277129b5-kube-api-access-xrxtr\") pod \"model-serving-api-54d89bd5fc-wkt5h\" (UID: \"87a0829b-2c60-4132-be07-8bd3277129b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.532023 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.531992 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:36.648433 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.648175 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:36.666534 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.666504 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-wkt5h"] Jul 17 17:54:36.668576 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:36.668542 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a0829b_2c60_4132_be07_8bd3277129b5.slice/crio-cdc19b6255e7a46e34821f476ec7bf20764565d46d47e2158332029c347b0f1c WatchSource:0}: Error finding container cdc19b6255e7a46e34821f476ec7bf20764565d46d47e2158332029c347b0f1c: Status 404 returned error can't find the container with id cdc19b6255e7a46e34821f476ec7bf20764565d46d47e2158332029c347b0f1c Jul 17 17:54:36.803135 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.803100 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2hn2x"] Jul 17 17:54:36.805537 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:36.805504 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad9848d_0a8c_4df4_9c7f_98bd57e9fa51.slice/crio-992f80227daf1d92523b6cb2162656f2752a2cb37a6e4be0abccac52a5488dd9 WatchSource:0}: Error finding container 992f80227daf1d92523b6cb2162656f2752a2cb37a6e4be0abccac52a5488dd9: Status 404 returned error can't find the container with id 992f80227daf1d92523b6cb2162656f2752a2cb37a6e4be0abccac52a5488dd9 Jul 17 17:54:36.834733 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.834695 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pczvg"] Jul 17 17:54:36.836910 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.836887 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:36.839958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.839927 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-klb54\"" Jul 17 17:54:36.840408 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.840254 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 17 17:54:36.840408 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.840285 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 17 17:54:36.840408 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.840306 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 17 17:54:36.840610 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.840509 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 17 17:54:36.851356 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.851326 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pczvg"] Jul 17 17:54:36.959384 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.959346 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-istio-token\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:36.959384 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.959382 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a30903b3-e300-4714-af26-01b31f506412-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:36.959616 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.959411 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a30903b3-e300-4714-af26-01b31f506412-local-certs\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:36.959616 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.959432 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-cacerts\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:36.959616 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.959509 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:36.959616 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.959547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:36.959616 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:36.959569 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5ww6\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-kube-api-access-n5ww6\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.060897 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.060843 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a30903b3-e300-4714-af26-01b31f506412-local-certs\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.060897 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.060895 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-cacerts\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.061152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.060938 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.061152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.060969 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.061152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.060997 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5ww6\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-kube-api-access-n5ww6\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.061152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.061046 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-istio-token\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.061152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.061069 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a30903b3-e300-4714-af26-01b31f506412-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.062232 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.062197 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a30903b3-e300-4714-af26-01b31f506412-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.063977 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.063930 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-cacerts\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.064090 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.063978 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a30903b3-e300-4714-af26-01b31f506412-local-certs\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.064090 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.064039 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.064199 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.064157 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.070814 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.070785 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-istio-token\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.071163 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.071141 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5ww6\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-kube-api-access-n5ww6\") pod \"istiod-openshift-gateway-7574459656-pczvg\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.148123 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.148081 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:37.300394 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.300361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" event={"ID":"87a0829b-2c60-4132-be07-8bd3277129b5","Type":"ContainerStarted","Data":"cdc19b6255e7a46e34821f476ec7bf20764565d46d47e2158332029c347b0f1c"} Jul 17 17:54:37.301404 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.301379 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" event={"ID":"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51","Type":"ContainerStarted","Data":"992f80227daf1d92523b6cb2162656f2752a2cb37a6e4be0abccac52a5488dd9"} Jul 17 17:54:37.304668 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:37.304556 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pczvg"] Jul 17 17:54:37.307119 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:37.307095 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30903b3_e300_4714_af26_01b31f506412.slice/crio-446857ecab40e121c51c2e5cdfdec43d4c70c275ce9a99607a8f228433786926 WatchSource:0}: Error finding container 446857ecab40e121c51c2e5cdfdec43d4c70c275ce9a99607a8f228433786926: Status 404 returned error can't find the container with id 446857ecab40e121c51c2e5cdfdec43d4c70c275ce9a99607a8f228433786926 Jul 17 17:54:38.307699 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:38.307625 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" event={"ID":"a30903b3-e300-4714-af26-01b31f506412","Type":"ContainerStarted","Data":"446857ecab40e121c51c2e5cdfdec43d4c70c275ce9a99607a8f228433786926"} Jul 17 17:54:41.641371 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:41.641319 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:54:41.641796 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:41.641415 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:54:42.325493 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.325436 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" event={"ID":"87a0829b-2c60-4132-be07-8bd3277129b5","Type":"ContainerStarted","Data":"e895bd8b2a991fed26ed94f91a912c87aff67b94f905985ac5ee3d2f0c002097"} Jul 17 17:54:42.325701 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.325515 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:54:42.326910 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.326885 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" event={"ID":"6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51","Type":"ContainerStarted","Data":"7ed142fae370f3648cb1ad1ff35a5ccaf982a7cb78ef9990954c69537fdc11d2"} Jul 17 17:54:42.327040 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.326960 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:42.328541 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.328517 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" event={"ID":"a30903b3-e300-4714-af26-01b31f506412","Type":"ContainerStarted","Data":"49e07e10fa014e3ad73228e15dd50950acca2a70db26eb08a35ca55ebe922f6d"} Jul 17 17:54:42.328680 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.328667 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:42.329914 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.329890 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" event={"ID":"ad9b4441-bd66-49b4-abb5-7e9402abf206","Type":"ContainerStarted","Data":"6225dc1bdad901e9d8dcfbb78de7bae9f1fd612967214ad68a2ba122c02dcef8"} Jul 17 17:54:42.330636 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.330617 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-pczvg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 17:54:42.330711 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.330656 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" podUID="a30903b3-e300-4714-af26-01b31f506412" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 17:54:42.367516 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.367454 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" podStartSLOduration=1.397228669 podStartE2EDuration="6.367437192s" totalImagesPullingTime="4.970208523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:42.366401518 +0000 UTC m=+316.721253099" watchObservedRunningTime="2026-07-17 17:54:42.367437192 +0000 UTC m=+316.722288772" Jul 17 17:54:42.393594 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.393523 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6799b9db4b-k46vt" podStartSLOduration=1.788214784 podStartE2EDuration="7.393502859s" totalImagesPullingTime="5.605288075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:42.391305318 +0000 UTC m=+316.746156900" watchObservedRunningTime="2026-07-17 17:54:42.393502859 +0000 UTC m=+316.748354442" Jul 17 17:54:42.419727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.418555 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" podStartSLOduration=2.086509241 podStartE2EDuration="6.418532254s" totalImagesPullingTime="4.332023013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:42.416777585 +0000 UTC m=+316.771629158" watchObservedRunningTime="2026-07-17 17:54:42.418532254 +0000 UTC m=+316.773383835" Jul 17 17:54:42.437202 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:42.437118 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" podStartSLOduration=2.56189657 podStartE2EDuration="7.437096309s" totalImagesPullingTime="4.875199739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:42.436109349 +0000 UTC m=+316.790960932" watchObservedRunningTime="2026-07-17 17:54:42.437096309 +0000 UTC m=+316.791947890" Jul 17 17:54:43.095783 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.095735 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7"] Jul 17 17:54:43.098265 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.098241 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.100952 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.100922 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-slprn\"" Jul 17 17:54:43.110182 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.110155 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7"] Jul 17 17:54:43.216395 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216357 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216395 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216394 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216623 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216414 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8c8972-da98-4d3e-b15f-1e60400712bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216623 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216443 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216623 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216523 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216623 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216582 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216623 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216619 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bgch\" (UniqueName: \"kubernetes.io/projected/4c8c8972-da98-4d3e-b15f-1e60400712bb-kube-api-access-2bgch\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216799 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.216799 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.216694 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.317901 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.317832 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318092 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.317915 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318092 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.317934 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318092 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.317953 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8c8972-da98-4d3e-b15f-1e60400712bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318092 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.317982 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318092 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318067 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318330 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318330 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318144 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bgch\" (UniqueName: \"kubernetes.io/projected/4c8c8972-da98-4d3e-b15f-1e60400712bb-kube-api-access-2bgch\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318330 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318184 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318482 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318325 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318482 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318342 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318622 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318598 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318729 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318666 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c8c8972-da98-4d3e-b15f-1e60400712bb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.318773 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.318729 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.320517 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.320495 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.320620 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.320574 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.334937 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.334912 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:43.338454 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.338425 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c8c8972-da98-4d3e-b15f-1e60400712bb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.344433 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.344400 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bgch\" (UniqueName: \"kubernetes.io/projected/4c8c8972-da98-4d3e-b15f-1e60400712bb-kube-api-access-2bgch\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45zwv7\" (UID: \"4c8c8972-da98-4d3e-b15f-1e60400712bb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.409145 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.409063 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:43.551679 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:43.551651 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7"] Jul 17 17:54:43.553799 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:43.553764 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8c8972_da98_4d3e_b15f_1e60400712bb.slice/crio-6b6663d851eccfea4dc2762038b654ec76f6b24f00f8530fc78d8f032fb6de78 WatchSource:0}: Error finding container 6b6663d851eccfea4dc2762038b654ec76f6b24f00f8530fc78d8f032fb6de78: Status 404 returned error can't find the container with id 6b6663d851eccfea4dc2762038b654ec76f6b24f00f8530fc78d8f032fb6de78 Jul 17 17:54:44.340717 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:44.340675 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" event={"ID":"4c8c8972-da98-4d3e-b15f-1e60400712bb","Type":"ContainerStarted","Data":"6b6663d851eccfea4dc2762038b654ec76f6b24f00f8530fc78d8f032fb6de78"} Jul 17 17:54:45.727532 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.727485 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz"] Jul 17 17:54:45.733024 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.732995 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:45.736911 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.736883 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 17 17:54:45.739131 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.739107 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-kbcks\"" Jul 17 17:54:45.745254 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.745220 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj"] Jul 17 17:54:45.747507 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.747483 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:45.752328 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.752303 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qbs8c\"" Jul 17 17:54:45.752678 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.752648 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 17 17:54:45.771004 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.770970 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz"] Jul 17 17:54:45.790011 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.789928 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj"] Jul 17 17:54:45.839392 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.839344 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d9g9\" (UniqueName: \"kubernetes.io/projected/b5d043bf-d856-4682-8486-a3b65c601c44-kube-api-access-8d9g9\") pod \"kserve-controller-manager-d6f4b65b8-mhmxz\" (UID: \"b5d043bf-d856-4682-8486-a3b65c601c44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:45.839571 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.839420 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5d043bf-d856-4682-8486-a3b65c601c44-cert\") pod \"kserve-controller-manager-d6f4b65b8-mhmxz\" (UID: \"b5d043bf-d856-4682-8486-a3b65c601c44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:45.940693 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.940659 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qqnv\" (UniqueName: \"kubernetes.io/projected/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-kube-api-access-6qqnv\") pod \"llmisvc-controller-manager-777c6bd7d5-z27dj\" (UID: \"6562fb12-4c44-4415-a4e9-57db5e6e5fd7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:45.940901 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.940749 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d9g9\" (UniqueName: \"kubernetes.io/projected/b5d043bf-d856-4682-8486-a3b65c601c44-kube-api-access-8d9g9\") pod \"kserve-controller-manager-d6f4b65b8-mhmxz\" (UID: \"b5d043bf-d856-4682-8486-a3b65c601c44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:45.940901 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.940807 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5d043bf-d856-4682-8486-a3b65c601c44-cert\") pod \"kserve-controller-manager-d6f4b65b8-mhmxz\" (UID: \"b5d043bf-d856-4682-8486-a3b65c601c44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:45.940901 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.940832 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z27dj\" (UID: \"6562fb12-4c44-4415-a4e9-57db5e6e5fd7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:45.944108 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.944076 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5d043bf-d856-4682-8486-a3b65c601c44-cert\") pod \"kserve-controller-manager-d6f4b65b8-mhmxz\" (UID: \"b5d043bf-d856-4682-8486-a3b65c601c44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:45.954382 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:45.954346 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d9g9\" (UniqueName: \"kubernetes.io/projected/b5d043bf-d856-4682-8486-a3b65c601c44-kube-api-access-8d9g9\") pod \"kserve-controller-manager-d6f4b65b8-mhmxz\" (UID: \"b5d043bf-d856-4682-8486-a3b65c601c44\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:46.042071 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.042036 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qqnv\" (UniqueName: \"kubernetes.io/projected/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-kube-api-access-6qqnv\") pod \"llmisvc-controller-manager-777c6bd7d5-z27dj\" (UID: \"6562fb12-4c44-4415-a4e9-57db5e6e5fd7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:46.042276 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.042159 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z27dj\" (UID: \"6562fb12-4c44-4415-a4e9-57db5e6e5fd7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:46.042276 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:54:46.042272 2552 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 17 17:54:46.042392 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:54:46.042343 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-cert podName:6562fb12-4c44-4415-a4e9-57db5e6e5fd7 nodeName:}" failed. No retries permitted until 2026-07-17 17:54:46.54232109 +0000 UTC m=+320.897172665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-cert") pod "llmisvc-controller-manager-777c6bd7d5-z27dj" (UID: "6562fb12-4c44-4415-a4e9-57db5e6e5fd7") : secret "llmisvc-webhook-server-cert" not found Jul 17 17:54:46.046051 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.046021 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:46.066102 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.066067 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qqnv\" (UniqueName: \"kubernetes.io/projected/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-kube-api-access-6qqnv\") pod \"llmisvc-controller-manager-777c6bd7d5-z27dj\" (UID: \"6562fb12-4c44-4415-a4e9-57db5e6e5fd7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:46.245899 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.245764 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:54:46.245899 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.245887 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:54:46.246218 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.245935 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:54:46.328766 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.328735 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz"] Jul 17 17:54:46.332366 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:46.332338 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d043bf_d856_4682_8486_a3b65c601c44.slice/crio-468005bc53e6463981c1bf8269d13c1c9ca71ab8c2d411013e34231828af68a2 WatchSource:0}: Error finding container 468005bc53e6463981c1bf8269d13c1c9ca71ab8c2d411013e34231828af68a2: Status 404 returned error can't find the container with id 468005bc53e6463981c1bf8269d13c1c9ca71ab8c2d411013e34231828af68a2 Jul 17 17:54:46.353586 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.353547 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" event={"ID":"4c8c8972-da98-4d3e-b15f-1e60400712bb","Type":"ContainerStarted","Data":"b701af9e80707115bd5efff2e4b55d35a0c624c3eaf9b552a9ab91ece896de44"} Jul 17 17:54:46.355312 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.355241 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" event={"ID":"b5d043bf-d856-4682-8486-a3b65c601c44","Type":"ContainerStarted","Data":"468005bc53e6463981c1bf8269d13c1c9ca71ab8c2d411013e34231828af68a2"} Jul 17 17:54:46.379196 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.379138 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" podStartSLOduration=0.689663942 podStartE2EDuration="3.379117381s" totalImagesPullingTime="2.689453439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:46.378279671 +0000 UTC m=+320.733131264" watchObservedRunningTime="2026-07-17 17:54:46.379117381 +0000 UTC m=+320.733969024" Jul 17 17:54:46.409250 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.409217 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:46.546020 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.545733 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z27dj\" (UID: \"6562fb12-4c44-4415-a4e9-57db5e6e5fd7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:46.548318 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.548263 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6562fb12-4c44-4415-a4e9-57db5e6e5fd7-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-z27dj\" (UID: \"6562fb12-4c44-4415-a4e9-57db5e6e5fd7\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:46.658378 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.658337 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:46.798100 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:46.798070 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj"] Jul 17 17:54:46.800736 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:54:46.800709 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6562fb12_4c44_4415_a4e9_57db5e6e5fd7.slice/crio-bc934552d5b7e9fd4fb6b6fa5a5283da7ff524bbfa2ac233e854517436d32732 WatchSource:0}: Error finding container bc934552d5b7e9fd4fb6b6fa5a5283da7ff524bbfa2ac233e854517436d32732: Status 404 returned error can't find the container with id bc934552d5b7e9fd4fb6b6fa5a5283da7ff524bbfa2ac233e854517436d32732 Jul 17 17:54:47.187087 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.187001 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pczvg"] Jul 17 17:54:47.187234 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.187197 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" podUID="a30903b3-e300-4714-af26-01b31f506412" containerName="discovery" containerID="cri-o://49e07e10fa014e3ad73228e15dd50950acca2a70db26eb08a35ca55ebe922f6d" gracePeriod=30 Jul 17 17:54:47.379333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.379089 2552 generic.go:356] "Generic (PLEG): container finished" podID="a30903b3-e300-4714-af26-01b31f506412" containerID="49e07e10fa014e3ad73228e15dd50950acca2a70db26eb08a35ca55ebe922f6d" exitCode=0 Jul 17 17:54:47.379333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.379222 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" event={"ID":"a30903b3-e300-4714-af26-01b31f506412","Type":"ContainerDied","Data":"49e07e10fa014e3ad73228e15dd50950acca2a70db26eb08a35ca55ebe922f6d"} Jul 17 17:54:47.383894 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.383603 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" event={"ID":"6562fb12-4c44-4415-a4e9-57db5e6e5fd7","Type":"ContainerStarted","Data":"bc934552d5b7e9fd4fb6b6fa5a5283da7ff524bbfa2ac233e854517436d32732"} Jul 17 17:54:47.416632 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.416348 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:47.468025 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.467993 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:47.556117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.556077 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-cacerts\") pod \"a30903b3-e300-4714-af26-01b31f506412\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " Jul 17 17:54:47.556117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.556118 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-csr-dns-cert\") pod \"a30903b3-e300-4714-af26-01b31f506412\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " Jul 17 17:54:47.556346 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.556159 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a30903b3-e300-4714-af26-01b31f506412-local-certs\") pod \"a30903b3-e300-4714-af26-01b31f506412\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " Jul 17 17:54:47.556346 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.556188 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a30903b3-e300-4714-af26-01b31f506412-istio-csr-ca-configmap\") pod \"a30903b3-e300-4714-af26-01b31f506412\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " Jul 17 17:54:47.556346 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.556216 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-istio-token\") pod \"a30903b3-e300-4714-af26-01b31f506412\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " Jul 17 17:54:47.556346 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.556240 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5ww6\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-kube-api-access-n5ww6\") pod \"a30903b3-e300-4714-af26-01b31f506412\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " Jul 17 17:54:47.556346 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.556290 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-kubeconfig\") pod \"a30903b3-e300-4714-af26-01b31f506412\" (UID: \"a30903b3-e300-4714-af26-01b31f506412\") " Jul 17 17:54:47.558748 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.557487 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a30903b3-e300-4714-af26-01b31f506412-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "a30903b3-e300-4714-af26-01b31f506412" (UID: "a30903b3-e300-4714-af26-01b31f506412"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 17:54:47.559467 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.559323 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "a30903b3-e300-4714-af26-01b31f506412" (UID: "a30903b3-e300-4714-af26-01b31f506412"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:54:47.560017 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.559781 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a30903b3-e300-4714-af26-01b31f506412-local-certs" (OuterVolumeSpecName: "local-certs") pod "a30903b3-e300-4714-af26-01b31f506412" (UID: "a30903b3-e300-4714-af26-01b31f506412"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:54:47.560225 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.560192 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-cacerts" (OuterVolumeSpecName: "cacerts") pod "a30903b3-e300-4714-af26-01b31f506412" (UID: "a30903b3-e300-4714-af26-01b31f506412"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:54:47.560450 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.560358 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-kube-api-access-n5ww6" (OuterVolumeSpecName: "kube-api-access-n5ww6") pod "a30903b3-e300-4714-af26-01b31f506412" (UID: "a30903b3-e300-4714-af26-01b31f506412"). InnerVolumeSpecName "kube-api-access-n5ww6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:54:47.560622 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.560474 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-istio-token" (OuterVolumeSpecName: "istio-token") pod "a30903b3-e300-4714-af26-01b31f506412" (UID: "a30903b3-e300-4714-af26-01b31f506412"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:54:47.561474 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.561446 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "a30903b3-e300-4714-af26-01b31f506412" (UID: "a30903b3-e300-4714-af26-01b31f506412"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 17:54:47.657854 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.657822 2552 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a30903b3-e300-4714-af26-01b31f506412-local-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:54:47.657854 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.657853 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a30903b3-e300-4714-af26-01b31f506412-istio-csr-ca-configmap\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:54:47.658061 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.657883 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:54:47.658061 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.657892 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5ww6\" (UniqueName: \"kubernetes.io/projected/a30903b3-e300-4714-af26-01b31f506412-kube-api-access-n5ww6\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:54:47.658061 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.657901 2552 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-kubeconfig\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:54:47.658061 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.657909 2552 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-cacerts\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:54:47.658061 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:47.657917 2552 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a30903b3-e300-4714-af26-01b31f506412-istio-csr-dns-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:54:48.391169 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:48.390444 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" Jul 17 17:54:48.391169 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:48.390472 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-pczvg" event={"ID":"a30903b3-e300-4714-af26-01b31f506412","Type":"ContainerDied","Data":"446857ecab40e121c51c2e5cdfdec43d4c70c275ce9a99607a8f228433786926"} Jul 17 17:54:48.391169 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:48.390542 2552 scope.go:117] "RemoveContainer" containerID="49e07e10fa014e3ad73228e15dd50950acca2a70db26eb08a35ca55ebe922f6d" Jul 17 17:54:48.392685 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:48.391308 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:48.392685 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:48.392548 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45zwv7" Jul 17 17:54:48.411465 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:48.411426 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pczvg"] Jul 17 17:54:48.415381 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:48.415347 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-pczvg"] Jul 17 17:54:49.398704 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:49.398663 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" event={"ID":"b5d043bf-d856-4682-8486-a3b65c601c44","Type":"ContainerStarted","Data":"de95c8a94522835934fb11bdd6d724670f22d8741c3772e7b78a0f6e433135e4"} Jul 17 17:54:49.399205 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:49.398901 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:54:49.417231 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:49.417179 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" podStartSLOduration=1.805182253 podStartE2EDuration="4.417159761s" totalImagesPullingTime="2.611977508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:49.415885233 +0000 UTC m=+323.770736815" watchObservedRunningTime="2026-07-17 17:54:49.417159761 +0000 UTC m=+323.772011343" Jul 17 17:54:50.126297 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:50.126259 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a30903b3-e300-4714-af26-01b31f506412" path="/var/lib/kubelet/pods/a30903b3-e300-4714-af26-01b31f506412/volumes" Jul 17 17:54:50.403836 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:50.403737 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" event={"ID":"6562fb12-4c44-4415-a4e9-57db5e6e5fd7","Type":"ContainerStarted","Data":"0557c7c575c81b0b3217e01b2a0623426ce5e67f8233ccdd0d49347d2a83e3f5"} Jul 17 17:54:50.404234 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:50.403875 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:54:50.422484 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:50.422430 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" podStartSLOduration=2.52691836 podStartE2EDuration="5.422411838s" totalImagesPullingTime="2.895493478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:54:50.421507394 +0000 UTC m=+324.776358968" watchObservedRunningTime="2026-07-17 17:54:50.422411838 +0000 UTC m=+324.777263418" Jul 17 17:54:53.337252 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:53.337215 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2hn2x" Jul 17 17:54:53.339610 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:54:53.339593 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-wkt5h" Jul 17 17:55:20.409430 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:20.409345 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mhmxz" Jul 17 17:55:21.410965 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:21.410928 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-z27dj" Jul 17 17:55:36.748225 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.748187 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tcz6"] Jul 17 17:55:36.748607 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.748489 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a30903b3-e300-4714-af26-01b31f506412" containerName="discovery" Jul 17 17:55:36.748607 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.748500 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a30903b3-e300-4714-af26-01b31f506412" containerName="discovery" Jul 17 17:55:36.748607 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.748551 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a30903b3-e300-4714-af26-01b31f506412" containerName="discovery" Jul 17 17:55:36.753925 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.753896 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" Jul 17 17:55:36.757356 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.757321 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 17 17:55:36.763575 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.763438 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 17 17:55:36.764349 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.764314 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bttns\"" Jul 17 17:55:36.767091 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.767061 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tcz6"] Jul 17 17:55:36.843763 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.843718 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wrnv\" (UniqueName: \"kubernetes.io/projected/cd8cff2f-8293-4bd4-bdce-76c360230c26-kube-api-access-8wrnv\") pod \"kuadrant-operator-catalog-4tcz6\" (UID: \"cd8cff2f-8293-4bd4-bdce-76c360230c26\") " pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" Jul 17 17:55:36.944738 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.944699 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wrnv\" (UniqueName: \"kubernetes.io/projected/cd8cff2f-8293-4bd4-bdce-76c360230c26-kube-api-access-8wrnv\") pod \"kuadrant-operator-catalog-4tcz6\" (UID: \"cd8cff2f-8293-4bd4-bdce-76c360230c26\") " pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" Jul 17 17:55:36.953486 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:36.953454 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wrnv\" (UniqueName: \"kubernetes.io/projected/cd8cff2f-8293-4bd4-bdce-76c360230c26-kube-api-access-8wrnv\") pod \"kuadrant-operator-catalog-4tcz6\" (UID: \"cd8cff2f-8293-4bd4-bdce-76c360230c26\") " pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" Jul 17 17:55:37.071061 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.071028 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" Jul 17 17:55:37.105337 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.105292 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tcz6"] Jul 17 17:55:37.200311 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.200285 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tcz6"] Jul 17 17:55:37.202523 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:55:37.202498 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8cff2f_8293_4bd4_bdce_76c360230c26.slice/crio-e25fe46044529fa1a2073929d4ba814d999e43654000689b793512836576b6bd WatchSource:0}: Error finding container e25fe46044529fa1a2073929d4ba814d999e43654000689b793512836576b6bd: Status 404 returned error can't find the container with id e25fe46044529fa1a2073929d4ba814d999e43654000689b793512836576b6bd Jul 17 17:55:37.314932 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.314888 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6zxw"] Jul 17 17:55:37.317789 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.317767 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:37.325572 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.325547 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6zxw"] Jul 17 17:55:37.450009 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.449967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4kl\" (UniqueName: \"kubernetes.io/projected/f0a0822a-b481-4056-9b69-85931e33866e-kube-api-access-wm4kl\") pod \"kuadrant-operator-catalog-r6zxw\" (UID: \"f0a0822a-b481-4056-9b69-85931e33866e\") " pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:37.550834 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.550799 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4kl\" (UniqueName: \"kubernetes.io/projected/f0a0822a-b481-4056-9b69-85931e33866e-kube-api-access-wm4kl\") pod \"kuadrant-operator-catalog-r6zxw\" (UID: \"f0a0822a-b481-4056-9b69-85931e33866e\") " pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:37.558908 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.558875 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4kl\" (UniqueName: \"kubernetes.io/projected/f0a0822a-b481-4056-9b69-85931e33866e-kube-api-access-wm4kl\") pod \"kuadrant-operator-catalog-r6zxw\" (UID: \"f0a0822a-b481-4056-9b69-85931e33866e\") " pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:37.595378 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.595290 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" event={"ID":"cd8cff2f-8293-4bd4-bdce-76c360230c26","Type":"ContainerStarted","Data":"e25fe46044529fa1a2073929d4ba814d999e43654000689b793512836576b6bd"} Jul 17 17:55:37.628500 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.628459 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:37.768105 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:37.768043 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-r6zxw"] Jul 17 17:55:37.770181 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:55:37.770152 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a0822a_b481_4056_9b69_85931e33866e.slice/crio-883314591cc5d5be4b7b4ab0e52212bb610fa215c0b74fd66fa41d2095f69c89 WatchSource:0}: Error finding container 883314591cc5d5be4b7b4ab0e52212bb610fa215c0b74fd66fa41d2095f69c89: Status 404 returned error can't find the container with id 883314591cc5d5be4b7b4ab0e52212bb610fa215c0b74fd66fa41d2095f69c89 Jul 17 17:55:38.601798 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:38.601749 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" event={"ID":"f0a0822a-b481-4056-9b69-85931e33866e","Type":"ContainerStarted","Data":"883314591cc5d5be4b7b4ab0e52212bb610fa215c0b74fd66fa41d2095f69c89"} Jul 17 17:55:39.607256 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.607221 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" event={"ID":"cd8cff2f-8293-4bd4-bdce-76c360230c26","Type":"ContainerStarted","Data":"c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1"} Jul 17 17:55:39.607719 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.607277 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" podUID="cd8cff2f-8293-4bd4-bdce-76c360230c26" containerName="registry-server" containerID="cri-o://c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1" gracePeriod=2 Jul 17 17:55:39.608687 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.608660 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" event={"ID":"f0a0822a-b481-4056-9b69-85931e33866e","Type":"ContainerStarted","Data":"f743e5aa66036d168544a9ea1577302c1a6cd40563489df8e9b822900b7a7153"} Jul 17 17:55:39.623703 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.623653 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" podStartSLOduration=1.662666311 podStartE2EDuration="3.623635613s" totalImagesPullingTime="1.960969302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:55:39.623303036 +0000 UTC m=+373.978154616" watchObservedRunningTime="2026-07-17 17:55:39.623635613 +0000 UTC m=+373.978487192" Jul 17 17:55:39.639649 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.639585 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" podStartSLOduration=1.244368691 podStartE2EDuration="2.639568018s" totalImagesPullingTime="1.395199327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:55:39.638045047 +0000 UTC m=+373.992896629" watchObservedRunningTime="2026-07-17 17:55:39.639568018 +0000 UTC m=+373.994419598" Jul 17 17:55:39.851428 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.851405 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" Jul 17 17:55:39.971026 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.970939 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wrnv\" (UniqueName: \"kubernetes.io/projected/cd8cff2f-8293-4bd4-bdce-76c360230c26-kube-api-access-8wrnv\") pod \"cd8cff2f-8293-4bd4-bdce-76c360230c26\" (UID: \"cd8cff2f-8293-4bd4-bdce-76c360230c26\") " Jul 17 17:55:39.973385 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:39.973357 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8cff2f-8293-4bd4-bdce-76c360230c26-kube-api-access-8wrnv" (OuterVolumeSpecName: "kube-api-access-8wrnv") pod "cd8cff2f-8293-4bd4-bdce-76c360230c26" (UID: "cd8cff2f-8293-4bd4-bdce-76c360230c26"). InnerVolumeSpecName "kube-api-access-8wrnv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:55:40.071744 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.071702 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wrnv\" (UniqueName: \"kubernetes.io/projected/cd8cff2f-8293-4bd4-bdce-76c360230c26-kube-api-access-8wrnv\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:55:40.613762 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.613728 2552 generic.go:356] "Generic (PLEG): container finished" podID="cd8cff2f-8293-4bd4-bdce-76c360230c26" containerID="c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1" exitCode=0 Jul 17 17:55:40.614227 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.613787 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" Jul 17 17:55:40.614227 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.613819 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" event={"ID":"cd8cff2f-8293-4bd4-bdce-76c360230c26","Type":"ContainerDied","Data":"c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1"} Jul 17 17:55:40.614227 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.613916 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4tcz6" event={"ID":"cd8cff2f-8293-4bd4-bdce-76c360230c26","Type":"ContainerDied","Data":"e25fe46044529fa1a2073929d4ba814d999e43654000689b793512836576b6bd"} Jul 17 17:55:40.614227 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.613942 2552 scope.go:117] "RemoveContainer" containerID="c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1" Jul 17 17:55:40.623172 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.623153 2552 scope.go:117] "RemoveContainer" containerID="c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1" Jul 17 17:55:40.623455 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:55:40.623434 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1\": container with ID starting with c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1 not found: ID does not exist" containerID="c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1" Jul 17 17:55:40.623531 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.623467 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1"} err="failed to get container status \"c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1\": rpc error: code = NotFound desc = could not find container \"c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1\": container with ID starting with c1fda058138fd9cddd4344534a2f22bec5f13748d2f1c990f07d0f048f14cec1 not found: ID does not exist" Jul 17 17:55:40.631982 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.631954 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tcz6"] Jul 17 17:55:40.636532 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:40.636508 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4tcz6"] Jul 17 17:55:42.126171 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:42.126140 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8cff2f-8293-4bd4-bdce-76c360230c26" path="/var/lib/kubelet/pods/cd8cff2f-8293-4bd4-bdce-76c360230c26/volumes" Jul 17 17:55:47.629476 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:47.629434 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:47.629957 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:47.629534 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:47.652557 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:47.652525 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:55:47.675939 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:55:47.675910 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-r6zxw" Jul 17 17:56:08.352103 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.352065 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr"] Jul 17 17:56:08.352515 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.352352 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8cff2f-8293-4bd4-bdce-76c360230c26" containerName="registry-server" Jul 17 17:56:08.352515 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.352362 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8cff2f-8293-4bd4-bdce-76c360230c26" containerName="registry-server" Jul 17 17:56:08.352515 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.352430 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8cff2f-8293-4bd4-bdce-76c360230c26" containerName="registry-server" Jul 17 17:56:08.355386 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.355369 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:08.358645 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.358616 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mtq65\"" Jul 17 17:56:08.365351 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.365321 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr"] Jul 17 17:56:08.389187 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.389148 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf584\" (UniqueName: \"kubernetes.io/projected/6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d-kube-api-access-zf584\") pod \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" (UID: \"6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:08.489571 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.489530 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf584\" (UniqueName: \"kubernetes.io/projected/6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d-kube-api-access-zf584\") pod \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" (UID: \"6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:08.498617 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.498579 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf584\" (UniqueName: \"kubernetes.io/projected/6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d-kube-api-access-zf584\") pod \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" (UID: \"6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:08.665590 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.665475 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:08.803726 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:08.803669 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr"] Jul 17 17:56:08.806133 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:56:08.806108 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8668ba_79e7_4f1b_86c5_0d10ca0e2b6d.slice/crio-50590abfb05938896ea82e9e9a31e63c7520f9c844df3dad7f12e79e659b1c13 WatchSource:0}: Error finding container 50590abfb05938896ea82e9e9a31e63c7520f9c844df3dad7f12e79e659b1c13: Status 404 returned error can't find the container with id 50590abfb05938896ea82e9e9a31e63c7520f9c844df3dad7f12e79e659b1c13 Jul 17 17:56:09.734611 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:09.734576 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" event={"ID":"6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d","Type":"ContainerStarted","Data":"50590abfb05938896ea82e9e9a31e63c7520f9c844df3dad7f12e79e659b1c13"} Jul 17 17:56:10.741141 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:10.741055 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" event={"ID":"6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d","Type":"ContainerStarted","Data":"8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f"} Jul 17 17:56:10.741559 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:10.741178 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:10.757715 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:10.757655 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" podStartSLOduration=1.285239282 podStartE2EDuration="2.757637548s" totalImagesPullingTime="1.472398266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:10.75660442 +0000 UTC m=+405.111456000" watchObservedRunningTime="2026-07-17 17:56:10.757637548 +0000 UTC m=+405.112489202" Jul 17 17:56:11.822563 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:11.822528 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc"] Jul 17 17:56:11.825568 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:11.825548 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" Jul 17 17:56:11.828506 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:11.828484 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-whlc5\"" Jul 17 17:56:11.828619 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:11.828482 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 17 17:56:11.836318 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:11.836287 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc"] Jul 17 17:56:11.912740 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:11.912702 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqfzw\" (UniqueName: \"kubernetes.io/projected/7a5e1277-cbbe-4362-95ed-5afda5877dfe-kube-api-access-wqfzw\") pod \"dns-operator-controller-manager-864dd78c4c-b8gjc\" (UID: \"7a5e1277-cbbe-4362-95ed-5afda5877dfe\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" Jul 17 17:56:12.013509 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:12.013474 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqfzw\" (UniqueName: \"kubernetes.io/projected/7a5e1277-cbbe-4362-95ed-5afda5877dfe-kube-api-access-wqfzw\") pod \"dns-operator-controller-manager-864dd78c4c-b8gjc\" (UID: \"7a5e1277-cbbe-4362-95ed-5afda5877dfe\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" Jul 17 17:56:12.032588 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:12.032567 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqfzw\" (UniqueName: \"kubernetes.io/projected/7a5e1277-cbbe-4362-95ed-5afda5877dfe-kube-api-access-wqfzw\") pod \"dns-operator-controller-manager-864dd78c4c-b8gjc\" (UID: \"7a5e1277-cbbe-4362-95ed-5afda5877dfe\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" Jul 17 17:56:12.135124 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:12.135034 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" Jul 17 17:56:12.274433 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:12.274405 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc"] Jul 17 17:56:12.279330 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:56:12.279299 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5e1277_cbbe_4362_95ed_5afda5877dfe.slice/crio-e115cbe6259be4ff9bd89396462a703c4188c169017f540a89bb00af6d96e7fd WatchSource:0}: Error finding container e115cbe6259be4ff9bd89396462a703c4188c169017f540a89bb00af6d96e7fd: Status 404 returned error can't find the container with id e115cbe6259be4ff9bd89396462a703c4188c169017f540a89bb00af6d96e7fd Jul 17 17:56:12.750769 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:12.750734 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" event={"ID":"7a5e1277-cbbe-4362-95ed-5afda5877dfe","Type":"ContainerStarted","Data":"e115cbe6259be4ff9bd89396462a703c4188c169017f540a89bb00af6d96e7fd"} Jul 17 17:56:14.762040 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:14.762004 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" event={"ID":"7a5e1277-cbbe-4362-95ed-5afda5877dfe","Type":"ContainerStarted","Data":"ddd1cb9cd3f235f29f35a9df3a387ee2156003057674237bda0684325ff8f44c"} Jul 17 17:56:14.762455 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:14.762189 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" Jul 17 17:56:14.780561 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:14.780514 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" podStartSLOduration=1.7085186650000002 podStartE2EDuration="3.780498123s" totalImagesPullingTime="2.071979458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:14.779181431 +0000 UTC m=+409.134033012" watchObservedRunningTime="2026-07-17 17:56:14.780498123 +0000 UTC m=+409.135349703" Jul 17 17:56:15.705881 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:15.705842 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj"] Jul 17 17:56:15.708752 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:15.708732 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" Jul 17 17:56:15.711784 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:15.711762 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xxf5t\"" Jul 17 17:56:15.723130 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:15.723101 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj"] Jul 17 17:56:15.741022 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:15.740989 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mtfp\" (UniqueName: \"kubernetes.io/projected/be19b857-3f50-4b7f-a265-4f4a27f4c17b-kube-api-access-8mtfp\") pod \"authorino-operator-75cc8d5cb7-7n5rj\" (UID: \"be19b857-3f50-4b7f-a265-4f4a27f4c17b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" Jul 17 17:56:15.842424 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:15.842383 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mtfp\" (UniqueName: \"kubernetes.io/projected/be19b857-3f50-4b7f-a265-4f4a27f4c17b-kube-api-access-8mtfp\") pod \"authorino-operator-75cc8d5cb7-7n5rj\" (UID: \"be19b857-3f50-4b7f-a265-4f4a27f4c17b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" Jul 17 17:56:15.857930 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:15.857900 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mtfp\" (UniqueName: \"kubernetes.io/projected/be19b857-3f50-4b7f-a265-4f4a27f4c17b-kube-api-access-8mtfp\") pod \"authorino-operator-75cc8d5cb7-7n5rj\" (UID: \"be19b857-3f50-4b7f-a265-4f4a27f4c17b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" Jul 17 17:56:16.019117 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:16.019083 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" Jul 17 17:56:16.157996 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:16.157974 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj"] Jul 17 17:56:16.160902 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:56:16.160841 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe19b857_3f50_4b7f_a265_4f4a27f4c17b.slice/crio-aef047f402c226974d2af5eeb3c2625726c255a9e122239317fc6890d6dd9340 WatchSource:0}: Error finding container aef047f402c226974d2af5eeb3c2625726c255a9e122239317fc6890d6dd9340: Status 404 returned error can't find the container with id aef047f402c226974d2af5eeb3c2625726c255a9e122239317fc6890d6dd9340 Jul 17 17:56:16.773737 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:16.773620 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" event={"ID":"be19b857-3f50-4b7f-a265-4f4a27f4c17b","Type":"ContainerStarted","Data":"aef047f402c226974d2af5eeb3c2625726c255a9e122239317fc6890d6dd9340"} Jul 17 17:56:18.784454 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:18.784418 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" event={"ID":"be19b857-3f50-4b7f-a265-4f4a27f4c17b","Type":"ContainerStarted","Data":"ef4bdf277d4f3d21d664563b9e8df5f9f15b964b39717adf8eebe64d7a3dbc46"} Jul 17 17:56:18.784845 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:18.784558 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" Jul 17 17:56:18.801607 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:18.801558 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" podStartSLOduration=1.618401033 podStartE2EDuration="3.801543219s" totalImagesPullingTime="2.183142186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:18.801495425 +0000 UTC m=+413.156347004" watchObservedRunningTime="2026-07-17 17:56:18.801543219 +0000 UTC m=+413.156394800" Jul 17 17:56:20.150421 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.150386 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7"] Jul 17 17:56:20.153719 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.153701 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.156742 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.156706 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hc8h4\"" Jul 17 17:56:20.166645 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.166615 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7"] Jul 17 17:56:20.172971 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.172922 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/946b30c0-f3b3-45cf-94d3-62f12e506ff5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.172971 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.172972 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms57m\" (UniqueName: \"kubernetes.io/projected/946b30c0-f3b3-45cf-94d3-62f12e506ff5-kube-api-access-ms57m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.274340 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.274304 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms57m\" (UniqueName: \"kubernetes.io/projected/946b30c0-f3b3-45cf-94d3-62f12e506ff5-kube-api-access-ms57m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.274537 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.274400 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/946b30c0-f3b3-45cf-94d3-62f12e506ff5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.274760 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.274743 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/946b30c0-f3b3-45cf-94d3-62f12e506ff5-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.283005 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.282976 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms57m\" (UniqueName: \"kubernetes.io/projected/946b30c0-f3b3-45cf-94d3-62f12e506ff5-kube-api-access-ms57m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.463746 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.463644 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:20.601269 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.601228 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7"] Jul 17 17:56:20.604371 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:56:20.604344 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946b30c0_f3b3_45cf_94d3_62f12e506ff5.slice/crio-f2dec92a11533fa61872db7b2cf6e1ff8516e7b6220bb308442b838d6a9729b3 WatchSource:0}: Error finding container f2dec92a11533fa61872db7b2cf6e1ff8516e7b6220bb308442b838d6a9729b3: Status 404 returned error can't find the container with id f2dec92a11533fa61872db7b2cf6e1ff8516e7b6220bb308442b838d6a9729b3 Jul 17 17:56:20.794358 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:20.794320 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" event={"ID":"946b30c0-f3b3-45cf-94d3-62f12e506ff5","Type":"ContainerStarted","Data":"f2dec92a11533fa61872db7b2cf6e1ff8516e7b6220bb308442b838d6a9729b3"} Jul 17 17:56:21.748411 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:21.748373 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:25.769209 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:25.769176 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-b8gjc" Jul 17 17:56:27.828902 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:27.828841 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" event={"ID":"946b30c0-f3b3-45cf-94d3-62f12e506ff5","Type":"ContainerStarted","Data":"a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520"} Jul 17 17:56:27.829290 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:27.828963 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:27.851221 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:27.851167 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" podStartSLOduration=1.703053767 podStartE2EDuration="7.851150813s" totalImagesPullingTime="6.148097046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:27.848614031 +0000 UTC m=+422.203465611" watchObservedRunningTime="2026-07-17 17:56:27.851150813 +0000 UTC m=+422.206002393" Jul 17 17:56:29.502514 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.502476 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78"] Jul 17 17:56:29.506120 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.506096 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.508756 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.508722 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 17 17:56:29.508756 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.508747 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-45nzb\"" Jul 17 17:56:29.509006 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.508928 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 17 17:56:29.514235 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.514209 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78"] Jul 17 17:56:29.538754 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.538709 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72c98c27-42fa-426b-80bf-fc1f8215a293-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.538953 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.538784 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c98c27-42fa-426b-80bf-fc1f8215a293-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.538953 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.538830 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzk2s\" (UniqueName: \"kubernetes.io/projected/72c98c27-42fa-426b-80bf-fc1f8215a293-kube-api-access-jzk2s\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.639324 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.639285 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72c98c27-42fa-426b-80bf-fc1f8215a293-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.639525 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.639337 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c98c27-42fa-426b-80bf-fc1f8215a293-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.639525 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.639371 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzk2s\" (UniqueName: \"kubernetes.io/projected/72c98c27-42fa-426b-80bf-fc1f8215a293-kube-api-access-jzk2s\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.639525 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:29.639495 2552 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 17 17:56:29.639647 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:29.639566 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72c98c27-42fa-426b-80bf-fc1f8215a293-plugin-serving-cert podName:72c98c27-42fa-426b-80bf-fc1f8215a293 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:30.139546849 +0000 UTC m=+424.494398421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/72c98c27-42fa-426b-80bf-fc1f8215a293-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-4sj78" (UID: "72c98c27-42fa-426b-80bf-fc1f8215a293") : secret "plugin-serving-cert" not found Jul 17 17:56:29.640054 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.640034 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/72c98c27-42fa-426b-80bf-fc1f8215a293-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.649950 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.649913 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzk2s\" (UniqueName: \"kubernetes.io/projected/72c98c27-42fa-426b-80bf-fc1f8215a293-kube-api-access-jzk2s\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:29.792023 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:29.791996 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7n5rj" Jul 17 17:56:30.142853 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:30.142760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c98c27-42fa-426b-80bf-fc1f8215a293-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:30.145305 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:30.145281 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/72c98c27-42fa-426b-80bf-fc1f8215a293-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-4sj78\" (UID: \"72c98c27-42fa-426b-80bf-fc1f8215a293\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:30.416691 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:30.416598 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" Jul 17 17:56:30.560773 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:30.560737 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78"] Jul 17 17:56:30.563457 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:56:30.563424 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72c98c27_42fa_426b_80bf_fc1f8215a293.slice/crio-1d76f3b6bf3bc049f7c4613abe070f0b38587ce0935e8bc572357eb23255ce56 WatchSource:0}: Error finding container 1d76f3b6bf3bc049f7c4613abe070f0b38587ce0935e8bc572357eb23255ce56: Status 404 returned error can't find the container with id 1d76f3b6bf3bc049f7c4613abe070f0b38587ce0935e8bc572357eb23255ce56 Jul 17 17:56:30.843472 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:30.843438 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" event={"ID":"72c98c27-42fa-426b-80bf-fc1f8215a293","Type":"ContainerStarted","Data":"1d76f3b6bf3bc049f7c4613abe070f0b38587ce0935e8bc572357eb23255ce56"} Jul 17 17:56:38.836558 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:38.836522 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:40.612307 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.612184 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7"] Jul 17 17:56:40.612758 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.612390 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" containerName="manager" containerID="cri-o://a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520" gracePeriod=2 Jul 17 17:56:40.625420 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.625391 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7"] Jul 17 17:56:40.627823 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:40.627778 2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"946b30c0-f3b3-45cf-94d3-62f12e506ff5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\": pods \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:40.642530 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.642493 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng"] Jul 17 17:56:40.642920 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.642901 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" containerName="manager" Jul 17 17:56:40.642920 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.642922 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" containerName="manager" Jul 17 17:56:40.643075 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.643043 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" containerName="manager" Jul 17 17:56:40.646333 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.646304 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr"] Jul 17 17:56:40.646456 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.646436 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:40.646542 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.646516 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" containerName="manager" containerID="cri-o://8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f" gracePeriod=2 Jul 17 17:56:40.650202 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:40.650138 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:40.657383 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.657351 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr"] Jul 17 17:56:40.663244 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.663144 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng"] Jul 17 17:56:40.670583 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.670543 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm"] Jul 17 17:56:40.671427 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.671392 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" containerName="manager" Jul 17 17:56:40.671427 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.671420 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" containerName="manager" Jul 17 17:56:40.671626 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.671502 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" containerName="manager" Jul 17 17:56:40.675521 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.675494 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" Jul 17 17:56:40.679634 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:40.679592 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:40.681950 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:40.681918 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:40.684725 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:40.684685 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:40.685213 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.685189 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm"] Jul 17 17:56:40.726760 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.726722 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xg9f\" (UniqueName: \"kubernetes.io/projected/5e1813d5-9032-44bf-b355-26068f5d3ea9-kube-api-access-8xg9f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wgqng\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:40.726934 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.726794 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e1813d5-9032-44bf-b355-26068f5d3ea9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wgqng\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:40.726934 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.726846 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qckrp\" (UniqueName: \"kubernetes.io/projected/969a6d08-218f-4e73-88bd-d70e7e4b68f0-kube-api-access-qckrp\") pod \"limitador-operator-controller-manager-859d7b78bd-mjzwm\" (UID: \"969a6d08-218f-4e73-88bd-d70e7e4b68f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" Jul 17 17:56:40.828255 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.828216 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xg9f\" (UniqueName: \"kubernetes.io/projected/5e1813d5-9032-44bf-b355-26068f5d3ea9-kube-api-access-8xg9f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wgqng\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:40.828440 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.828292 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e1813d5-9032-44bf-b355-26068f5d3ea9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wgqng\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:40.828440 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.828346 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qckrp\" (UniqueName: \"kubernetes.io/projected/969a6d08-218f-4e73-88bd-d70e7e4b68f0-kube-api-access-qckrp\") pod \"limitador-operator-controller-manager-859d7b78bd-mjzwm\" (UID: \"969a6d08-218f-4e73-88bd-d70e7e4b68f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" Jul 17 17:56:40.828728 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.828706 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e1813d5-9032-44bf-b355-26068f5d3ea9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wgqng\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:40.845205 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.845160 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qckrp\" (UniqueName: \"kubernetes.io/projected/969a6d08-218f-4e73-88bd-d70e7e4b68f0-kube-api-access-qckrp\") pod \"limitador-operator-controller-manager-859d7b78bd-mjzwm\" (UID: \"969a6d08-218f-4e73-88bd-d70e7e4b68f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" Jul 17 17:56:40.845346 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:40.845254 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xg9f\" (UniqueName: \"kubernetes.io/projected/5e1813d5-9032-44bf-b355-26068f5d3ea9-kube-api-access-8xg9f\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wgqng\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:41.041852 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:41.041810 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:41.049803 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:41.049772 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" Jul 17 17:56:42.745906 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:42.745838 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.25:8081/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 17 17:56:53.378017 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.377992 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:53.380664 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.380643 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:53.381096 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.381073 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:53.383737 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.383705 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:53.386525 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.386490 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:53.400197 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.400174 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng"] Jul 17 17:56:53.402793 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:56:53.402758 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1813d5_9032_44bf_b355_26068f5d3ea9.slice/crio-aed6bfd48495371e8e7a44efc4d1a3d40cc005dcdd06a5b6a0a9bb70d60d1b49 WatchSource:0}: Error finding container aed6bfd48495371e8e7a44efc4d1a3d40cc005dcdd06a5b6a0a9bb70d60d1b49: Status 404 returned error can't find the container with id aed6bfd48495371e8e7a44efc4d1a3d40cc005dcdd06a5b6a0a9bb70d60d1b49 Jul 17 17:56:53.416629 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.416602 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm"] Jul 17 17:56:53.419960 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:56:53.419933 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969a6d08_218f_4e73_88bd_d70e7e4b68f0.slice/crio-a693a3911c00cfe443cc45d2b10e35db056f419d44218fd0b2cada00ec994f38 WatchSource:0}: Error finding container a693a3911c00cfe443cc45d2b10e35db056f419d44218fd0b2cada00ec994f38: Status 404 returned error can't find the container with id a693a3911c00cfe443cc45d2b10e35db056f419d44218fd0b2cada00ec994f38 Jul 17 17:56:53.447725 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.447699 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms57m\" (UniqueName: \"kubernetes.io/projected/946b30c0-f3b3-45cf-94d3-62f12e506ff5-kube-api-access-ms57m\") pod \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " Jul 17 17:56:53.447899 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.447757 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf584\" (UniqueName: \"kubernetes.io/projected/6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d-kube-api-access-zf584\") pod \"6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d\" (UID: \"6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d\") " Jul 17 17:56:53.447899 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.447824 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/946b30c0-f3b3-45cf-94d3-62f12e506ff5-extensions-socket-volume\") pod \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\" (UID: \"946b30c0-f3b3-45cf-94d3-62f12e506ff5\") " Jul 17 17:56:53.448532 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.448496 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/946b30c0-f3b3-45cf-94d3-62f12e506ff5-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "946b30c0-f3b3-45cf-94d3-62f12e506ff5" (UID: "946b30c0-f3b3-45cf-94d3-62f12e506ff5"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:56:53.450139 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.450107 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/946b30c0-f3b3-45cf-94d3-62f12e506ff5-kube-api-access-ms57m" (OuterVolumeSpecName: "kube-api-access-ms57m") pod "946b30c0-f3b3-45cf-94d3-62f12e506ff5" (UID: "946b30c0-f3b3-45cf-94d3-62f12e506ff5"). InnerVolumeSpecName "kube-api-access-ms57m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:56:53.450886 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.450830 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d-kube-api-access-zf584" (OuterVolumeSpecName: "kube-api-access-zf584") pod "6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" (UID: "6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d"). InnerVolumeSpecName "kube-api-access-zf584". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:56:53.548707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.548662 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf584\" (UniqueName: \"kubernetes.io/projected/6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d-kube-api-access-zf584\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:56:53.548707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.548694 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/946b30c0-f3b3-45cf-94d3-62f12e506ff5-extensions-socket-volume\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:56:53.548707 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.548704 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms57m\" (UniqueName: \"kubernetes.io/projected/946b30c0-f3b3-45cf-94d3-62f12e506ff5-kube-api-access-ms57m\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:56:53.966130 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.966089 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" event={"ID":"72c98c27-42fa-426b-80bf-fc1f8215a293","Type":"ContainerStarted","Data":"4116d0d059dd65a7beac6ae274519e84b3909967421a2a6a949b620ead4fff53"} Jul 17 17:56:53.967673 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.967641 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" event={"ID":"5e1813d5-9032-44bf-b355-26068f5d3ea9","Type":"ContainerStarted","Data":"df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43"} Jul 17 17:56:53.967840 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.967694 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" event={"ID":"5e1813d5-9032-44bf-b355-26068f5d3ea9","Type":"ContainerStarted","Data":"aed6bfd48495371e8e7a44efc4d1a3d40cc005dcdd06a5b6a0a9bb70d60d1b49"} Jul 17 17:56:53.967840 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.967719 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:53.968606 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.968574 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:53.969309 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.969285 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" event={"ID":"969a6d08-218f-4e73-88bd-d70e7e4b68f0","Type":"ContainerStarted","Data":"94fd867a24388c1de4f338d436f1d8240152abf054523ee869d89047f59d7d8a"} Jul 17 17:56:53.969424 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.969322 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" event={"ID":"969a6d08-218f-4e73-88bd-d70e7e4b68f0","Type":"ContainerStarted","Data":"a693a3911c00cfe443cc45d2b10e35db056f419d44218fd0b2cada00ec994f38"} Jul 17 17:56:53.969424 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.969374 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" Jul 17 17:56:53.970522 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.970503 2552 generic.go:356] "Generic (PLEG): container finished" podID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" containerID="8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f" exitCode=0 Jul 17 17:56:53.970604 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.970536 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:53.970604 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.970595 2552 scope.go:117] "RemoveContainer" containerID="8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f" Jul 17 17:56:53.970768 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.970743 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:53.971951 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.971929 2552 generic.go:356] "Generic (PLEG): container finished" podID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" containerID="a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520" exitCode=0 Jul 17 17:56:53.972032 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.971969 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:53.980549 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.980532 2552 scope.go:117] "RemoveContainer" containerID="8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f" Jul 17 17:56:53.980895 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.980848 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f\": container with ID starting with 8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f not found: ID does not exist" containerID="8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f" Jul 17 17:56:53.980995 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.980907 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f"} err="failed to get container status \"8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f\": rpc error: code = NotFound desc = could not find container \"8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f\": container with ID starting with 8e09af7f09f4a1e396c3c2b7cde7752092d3a1f3a5bb0042877abc50c1eb891f not found: ID does not exist" Jul 17 17:56:53.980995 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.980933 2552 scope.go:117] "RemoveContainer" containerID="a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520" Jul 17 17:56:53.989079 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.989029 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-4sj78" podStartSLOduration=2.269060637 podStartE2EDuration="24.98901248s" totalImagesPullingTime="22.719951843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:53.987407291 +0000 UTC m=+448.342258872" watchObservedRunningTime="2026-07-17 17:56:53.98901248 +0000 UTC m=+448.343864059" Jul 17 17:56:53.989622 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.989602 2552 scope.go:117] "RemoveContainer" containerID="a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520" Jul 17 17:56:53.989910 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.989881 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qr4xr\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qr4xr" Jul 17 17:56:53.990035 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:53.989928 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520\": container with ID starting with a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520 not found: ID does not exist" containerID="a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520" Jul 17 17:56:53.990035 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:53.989958 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520"} err="failed to get container status \"a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520\": rpc error: code = NotFound desc = could not find container \"a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520\": container with ID starting with a88711a4bfdd20ec1e2cf385d90eb2e84ae96fa67f200f6be4553f3d8515b520 not found: ID does not exist" Jul 17 17:56:54.010451 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:54.010401 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" podStartSLOduration=14.010383529 podStartE2EDuration="14.010383529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:54.009948275 +0000 UTC m=+448.364799855" watchObservedRunningTime="2026-07-17 17:56:54.010383529 +0000 UTC m=+448.365235086" Jul 17 17:56:54.012289 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:54.012265 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-jjgc7\" is forbidden: User \"system:node:ip-10-0-138-33.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-33.ec2.internal' and this object" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jjgc7" Jul 17 17:56:54.031608 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:54.031511 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" podStartSLOduration=14.0314949 podStartE2EDuration="14.0314949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:54.0312585 +0000 UTC m=+448.386110081" watchObservedRunningTime="2026-07-17 17:56:54.0314949 +0000 UTC m=+448.386346503" Jul 17 17:56:54.127318 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:54.127276 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d" path="/var/lib/kubelet/pods/6e8668ba-79e7-4f1b-86c5-0d10ca0e2b6d/volumes" Jul 17 17:56:54.127716 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:54.127695 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="946b30c0-f3b3-45cf-94d3-62f12e506ff5" path="/var/lib/kubelet/pods/946b30c0-f3b3-45cf-94d3-62f12e506ff5/volumes" Jul 17 17:56:57.249968 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.249934 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng"] Jul 17 17:56:57.250545 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.250109 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" podUID="5e1813d5-9032-44bf-b355-26068f5d3ea9" containerName="manager" containerID="cri-o://df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43" gracePeriod=10 Jul 17 17:56:57.509243 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.509180 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:57.584724 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.584685 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e1813d5-9032-44bf-b355-26068f5d3ea9-extensions-socket-volume\") pod \"5e1813d5-9032-44bf-b355-26068f5d3ea9\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " Jul 17 17:56:57.584930 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.584741 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xg9f\" (UniqueName: \"kubernetes.io/projected/5e1813d5-9032-44bf-b355-26068f5d3ea9-kube-api-access-8xg9f\") pod \"5e1813d5-9032-44bf-b355-26068f5d3ea9\" (UID: \"5e1813d5-9032-44bf-b355-26068f5d3ea9\") " Jul 17 17:56:57.585152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.585127 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e1813d5-9032-44bf-b355-26068f5d3ea9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5e1813d5-9032-44bf-b355-26068f5d3ea9" (UID: "5e1813d5-9032-44bf-b355-26068f5d3ea9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 17:56:57.587205 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.587183 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e1813d5-9032-44bf-b355-26068f5d3ea9-kube-api-access-8xg9f" (OuterVolumeSpecName: "kube-api-access-8xg9f") pod "5e1813d5-9032-44bf-b355-26068f5d3ea9" (UID: "5e1813d5-9032-44bf-b355-26068f5d3ea9"). InnerVolumeSpecName "kube-api-access-8xg9f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 17:56:57.685728 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.685690 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e1813d5-9032-44bf-b355-26068f5d3ea9-extensions-socket-volume\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:56:57.685728 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:57.685719 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xg9f\" (UniqueName: \"kubernetes.io/projected/5e1813d5-9032-44bf-b355-26068f5d3ea9-kube-api-access-8xg9f\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 17:56:58.000053 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.000013 2552 generic.go:356] "Generic (PLEG): container finished" podID="5e1813d5-9032-44bf-b355-26068f5d3ea9" containerID="df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43" exitCode=0 Jul 17 17:56:58.000258 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.000063 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" Jul 17 17:56:58.000258 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.000068 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" event={"ID":"5e1813d5-9032-44bf-b355-26068f5d3ea9","Type":"ContainerDied","Data":"df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43"} Jul 17 17:56:58.000258 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.000219 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng" event={"ID":"5e1813d5-9032-44bf-b355-26068f5d3ea9","Type":"ContainerDied","Data":"aed6bfd48495371e8e7a44efc4d1a3d40cc005dcdd06a5b6a0a9bb70d60d1b49"} Jul 17 17:56:58.000258 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.000252 2552 scope.go:117] "RemoveContainer" containerID="df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43" Jul 17 17:56:58.009246 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.009225 2552 scope.go:117] "RemoveContainer" containerID="df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43" Jul 17 17:56:58.009568 ip-10-0-138-33 kubenswrapper[2552]: E0717 17:56:58.009549 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43\": container with ID starting with df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43 not found: ID does not exist" containerID="df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43" Jul 17 17:56:58.009628 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.009578 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43"} err="failed to get container status \"df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43\": rpc error: code = NotFound desc = could not find container \"df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43\": container with ID starting with df678245d0b9f16fc591cd4fe080ec87d0bd4c8b7561d1f91aad2ed2c13e1f43 not found: ID does not exist" Jul 17 17:56:58.021880 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.021839 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng"] Jul 17 17:56:58.025807 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.025781 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wgqng"] Jul 17 17:56:58.126163 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:56:58.126132 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1813d5-9032-44bf-b355-26068f5d3ea9" path="/var/lib/kubelet/pods/5e1813d5-9032-44bf-b355-26068f5d3ea9/volumes" Jul 17 17:57:04.981190 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:04.981157 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mjzwm" Jul 17 17:57:13.681424 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.681390 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv"] Jul 17 17:57:13.681823 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.681783 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1813d5-9032-44bf-b355-26068f5d3ea9" containerName="manager" Jul 17 17:57:13.681823 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.681795 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1813d5-9032-44bf-b355-26068f5d3ea9" containerName="manager" Jul 17 17:57:13.681947 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.681878 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1813d5-9032-44bf-b355-26068f5d3ea9" containerName="manager" Jul 17 17:57:13.802521 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.802475 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv"] Jul 17 17:57:13.802691 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.802610 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.805668 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.805640 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mrzrq\"" Jul 17 17:57:13.924690 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924649 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08958026-8da8-49d8-858b-52053601bb48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.924895 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924702 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08958026-8da8-49d8-858b-52053601bb48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.924895 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924738 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.924895 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924771 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.924895 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924798 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dqzb\" (UniqueName: \"kubernetes.io/projected/08958026-8da8-49d8-858b-52053601bb48-kube-api-access-5dqzb\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.924895 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924827 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08958026-8da8-49d8-858b-52053601bb48-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.924895 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924883 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.925133 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924911 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:13.925133 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:13.924935 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.026322 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026282 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08958026-8da8-49d8-858b-52053601bb48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.026523 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026337 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08958026-8da8-49d8-858b-52053601bb48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.026523 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026374 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.026523 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026408 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.026523 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dqzb\" (UniqueName: \"kubernetes.io/projected/08958026-8da8-49d8-858b-52053601bb48-kube-api-access-5dqzb\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.026523 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026464 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08958026-8da8-49d8-858b-52053601bb48-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.026790 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026529 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.027026 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.026999 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.027118 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.027009 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.027118 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.027074 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.027223 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.027163 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.027279 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.027243 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/08958026-8da8-49d8-858b-52053601bb48-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.027428 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.027408 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.027485 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.027409 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.029151 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.029129 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/08958026-8da8-49d8-858b-52053601bb48-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.029376 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.029355 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/08958026-8da8-49d8-858b-52053601bb48-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.035456 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.035432 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/08958026-8da8-49d8-858b-52053601bb48-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.035574 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.035557 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dqzb\" (UniqueName: \"kubernetes.io/projected/08958026-8da8-49d8-858b-52053601bb48-kube-api-access-5dqzb\") pod \"maas-default-gateway-openshift-default-56654dcf7-d2cnv\" (UID: \"08958026-8da8-49d8-858b-52053601bb48\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.113768 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.113733 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:14.280540 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.280512 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv"] Jul 17 17:57:14.282506 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:57:14.282480 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08958026_8da8_49d8_858b_52053601bb48.slice/crio-0fc41fba054b0226f6d72c5c06d0524e248119375809148b7eaedd3b0278ed7e WatchSource:0}: Error finding container 0fc41fba054b0226f6d72c5c06d0524e248119375809148b7eaedd3b0278ed7e: Status 404 returned error can't find the container with id 0fc41fba054b0226f6d72c5c06d0524e248119375809148b7eaedd3b0278ed7e Jul 17 17:57:14.285176 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.285144 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:57:14.285258 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.285211 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:57:14.285258 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:14.285240 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:57:15.081359 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:15.081324 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" event={"ID":"08958026-8da8-49d8-858b-52053601bb48","Type":"ContainerStarted","Data":"156ed43e25d4c1b4a6e42c63ab10d614b31d68340a6e2cc06fc470570a676df6"} Jul 17 17:57:15.081795 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:15.081412 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" event={"ID":"08958026-8da8-49d8-858b-52053601bb48","Type":"ContainerStarted","Data":"0fc41fba054b0226f6d72c5c06d0524e248119375809148b7eaedd3b0278ed7e"} Jul 17 17:57:15.102081 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:15.102029 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" podStartSLOduration=2.1020108 podStartE2EDuration="2.1020108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:15.100225001 +0000 UTC m=+469.455076606" watchObservedRunningTime="2026-07-17 17:57:15.1020108 +0000 UTC m=+469.456862379" Jul 17 17:57:15.114634 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:15.114599 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:15.119517 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:15.119490 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:16.086069 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:16.086042 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:16.086981 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:16.086962 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:57:27.908581 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:27.908543 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:57:27.945958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:27.945926 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:57:27.945958 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:27.945963 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:57:27.946161 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:27.946057 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:27.948727 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:27.948707 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 17 17:57:27.951766 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:27.951735 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/752f5730-b550-4cf4-85fe-fbd206b0c344-config-file\") pod \"limitador-limitador-54d6d988d5-j9ccc\" (UID: \"752f5730-b550-4cf4-85fe-fbd206b0c344\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:27.951890 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:27.951807 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfj85\" (UniqueName: \"kubernetes.io/projected/752f5730-b550-4cf4-85fe-fbd206b0c344-kube-api-access-kfj85\") pod \"limitador-limitador-54d6d988d5-j9ccc\" (UID: \"752f5730-b550-4cf4-85fe-fbd206b0c344\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:28.052344 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:28.052302 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/752f5730-b550-4cf4-85fe-fbd206b0c344-config-file\") pod \"limitador-limitador-54d6d988d5-j9ccc\" (UID: \"752f5730-b550-4cf4-85fe-fbd206b0c344\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:28.052535 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:28.052355 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfj85\" (UniqueName: \"kubernetes.io/projected/752f5730-b550-4cf4-85fe-fbd206b0c344-kube-api-access-kfj85\") pod \"limitador-limitador-54d6d988d5-j9ccc\" (UID: \"752f5730-b550-4cf4-85fe-fbd206b0c344\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:28.052996 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:28.052977 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/752f5730-b550-4cf4-85fe-fbd206b0c344-config-file\") pod \"limitador-limitador-54d6d988d5-j9ccc\" (UID: \"752f5730-b550-4cf4-85fe-fbd206b0c344\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:28.061055 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:28.061028 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfj85\" (UniqueName: \"kubernetes.io/projected/752f5730-b550-4cf4-85fe-fbd206b0c344-kube-api-access-kfj85\") pod \"limitador-limitador-54d6d988d5-j9ccc\" (UID: \"752f5730-b550-4cf4-85fe-fbd206b0c344\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:28.255823 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:28.255725 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:28.408634 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:28.408611 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:57:28.413020 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:57:28.412976 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod752f5730_b550_4cf4_85fe_fbd206b0c344.slice/crio-adf8819f01d04d7f54757dba695c69a3bce99b6fd2dd48f68a4674a8b739739e WatchSource:0}: Error finding container adf8819f01d04d7f54757dba695c69a3bce99b6fd2dd48f68a4674a8b739739e: Status 404 returned error can't find the container with id adf8819f01d04d7f54757dba695c69a3bce99b6fd2dd48f68a4674a8b739739e Jul 17 17:57:29.147620 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:29.147562 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" event={"ID":"752f5730-b550-4cf4-85fe-fbd206b0c344","Type":"ContainerStarted","Data":"adf8819f01d04d7f54757dba695c69a3bce99b6fd2dd48f68a4674a8b739739e"} Jul 17 17:57:31.158260 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:31.158225 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" event={"ID":"752f5730-b550-4cf4-85fe-fbd206b0c344","Type":"ContainerStarted","Data":"92a23ab4db157524efcb4241f193fb6af03206b05f0b1e4126a3b3d61dec965c"} Jul 17 17:57:31.158637 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:31.158400 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:57:31.173942 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:31.173846 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" podStartSLOduration=1.629190904 podStartE2EDuration="4.173827383s" totalImagesPullingTime="2.544636479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:31.173438665 +0000 UTC m=+485.528290258" watchObservedRunningTime="2026-07-17 17:57:31.173827383 +0000 UTC m=+485.528678966" Jul 17 17:57:42.163600 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:57:42.163556 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-j9ccc" Jul 17 17:58:45.127523 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:45.127491 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:58:53.513180 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:53.513143 2552 generic.go:356] "Generic (PLEG): container finished" podID="08958026-8da8-49d8-858b-52053601bb48" containerID="156ed43e25d4c1b4a6e42c63ab10d614b31d68340a6e2cc06fc470570a676df6" exitCode=0 Jul 17 17:58:53.513637 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:53.513223 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" event={"ID":"08958026-8da8-49d8-858b-52053601bb48","Type":"ContainerDied","Data":"156ed43e25d4c1b4a6e42c63ab10d614b31d68340a6e2cc06fc470570a676df6"} Jul 17 17:58:53.513702 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:53.513684 2552 scope.go:117] "RemoveContainer" containerID="156ed43e25d4c1b4a6e42c63ab10d614b31d68340a6e2cc06fc470570a676df6" Jul 17 17:58:53.514772 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:53.514744 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:58:53.514925 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:53.514830 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:58:53.514925 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:53.514906 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 17:58:54.519884 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:54.519829 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" event={"ID":"08958026-8da8-49d8-858b-52053601bb48","Type":"ContainerStarted","Data":"9cb2d8e88da0253de877960716390085e45af1777198d41ed2b69a7275460e70"} Jul 17 17:58:55.114407 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:55.114366 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:58:55.114595 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:55.114574 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-d2cnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 17 17:58:55.114646 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:55.114621 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" podUID="08958026-8da8-49d8-858b-52053601bb48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 17 17:58:56.114086 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:56.114051 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-d2cnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 17 17:58:56.114460 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:56.114123 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" podUID="08958026-8da8-49d8-858b-52053601bb48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 17 17:58:57.114613 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:57.114568 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-d2cnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 17 17:58:57.115043 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:57.114631 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" podUID="08958026-8da8-49d8-858b-52053601bb48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 17 17:58:58.114548 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:58.114508 2552 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-d2cnv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body= Jul 17 17:58:58.114745 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:58.114565 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" podUID="08958026-8da8-49d8-858b-52053601bb48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" Jul 17 17:58:59.118033 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:59.118000 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:58:59.118427 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:59.118288 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:58:59.119121 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:58:59.119101 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-d2cnv" Jul 17 17:59:04.729659 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:04.729622 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:59:11.424037 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:11.423991 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:59:17.603161 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.603117 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg"] Jul 17 17:59:17.606033 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.606010 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.609020 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.608995 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 17 17:59:17.610152 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.610131 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fv28k\"" Jul 17 17:59:17.610323 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.610307 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 17 17:59:17.610646 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.610631 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 17 17:59:17.615224 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.615193 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.615344 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.615241 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jk89\" (UniqueName: \"kubernetes.io/projected/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-kube-api-access-7jk89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.615410 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.615341 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.615410 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.615367 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.615410 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.615406 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.615554 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.615507 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.615939 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.615918 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg"] Jul 17 17:59:17.716091 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716046 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716091 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716088 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716335 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716115 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716335 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716335 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716191 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716335 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716209 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jk89\" (UniqueName: \"kubernetes.io/projected/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-kube-api-access-7jk89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716569 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716540 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716569 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716563 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.716684 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.716643 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.718675 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.718653 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.718804 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.718788 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.724818 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.724793 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jk89\" (UniqueName: \"kubernetes.io/projected/fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64-kube-api-access-7jk89\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tz6cg\" (UID: \"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:17.917372 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:17.917285 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:18.055314 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:18.055287 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg"] Jul 17 17:59:18.057118 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:59:18.057091 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa3ad60f_61c2_4f8c_a0c2_9e64e6eefb64.slice/crio-7972410022b9ef8d94f13b4f26981998dc0d8fc1d9283260cbd994d35f956d34 WatchSource:0}: Error finding container 7972410022b9ef8d94f13b4f26981998dc0d8fc1d9283260cbd994d35f956d34: Status 404 returned error can't find the container with id 7972410022b9ef8d94f13b4f26981998dc0d8fc1d9283260cbd994d35f956d34 Jul 17 17:59:18.632708 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:18.632674 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" event={"ID":"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64","Type":"ContainerStarted","Data":"7972410022b9ef8d94f13b4f26981998dc0d8fc1d9283260cbd994d35f956d34"} Jul 17 17:59:18.941620 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:18.941522 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:59:19.645194 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:19.645153 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" event={"ID":"fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64","Type":"ContainerStarted","Data":"b81a26aeab3135854ee4dd4c09a755e6537bc371827a15affa42cab63295bec2"} Jul 17 17:59:19.664310 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:19.664250 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" podStartSLOduration=1.631057626 podStartE2EDuration="2.664233171s" totalImagesPullingTime="1.033175545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:59:19.662527583 +0000 UTC m=+594.017379165" watchObservedRunningTime="2026-07-17 17:59:19.664233171 +0000 UTC m=+594.019084793" Jul 17 17:59:24.836928 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:24.836887 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:59:27.917840 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:27.917799 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:27.918294 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:27.917925 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:27.930467 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:27.930440 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:28.696722 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:28.696688 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tz6cg" Jul 17 17:59:34.311698 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.311662 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj"] Jul 17 17:59:34.315349 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.315330 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.318191 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.318169 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 17 17:59:34.322557 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.322255 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj"] Jul 17 17:59:34.359926 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.359856 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.359926 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.359928 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.360143 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.360007 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83347a28-4a67-4674-999b-78d568289833-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.360143 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.360045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndbns\" (UniqueName: \"kubernetes.io/projected/83347a28-4a67-4674-999b-78d568289833-kube-api-access-ndbns\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.360143 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.360114 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.360242 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.360156 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.461624 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.461584 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.461624 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.461630 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.461856 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.461657 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83347a28-4a67-4674-999b-78d568289833-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.461856 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.461681 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndbns\" (UniqueName: \"kubernetes.io/projected/83347a28-4a67-4674-999b-78d568289833-kube-api-access-ndbns\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.461856 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.461716 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.461856 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.461750 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.462124 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.462103 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.462187 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.462130 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.462245 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.462199 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.464310 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.464285 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83347a28-4a67-4674-999b-78d568289833-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.464580 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.464561 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83347a28-4a67-4674-999b-78d568289833-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.470128 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.470099 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndbns\" (UniqueName: \"kubernetes.io/projected/83347a28-4a67-4674-999b-78d568289833-kube-api-access-ndbns\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-8xpcj\" (UID: \"83347a28-4a67-4674-999b-78d568289833\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.626934 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.626837 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:34.765279 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:34.765225 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj"] Jul 17 17:59:34.767445 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:59:34.767396 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83347a28_4a67_4674_999b_78d568289833.slice/crio-f2df3a324d5d06e89b60b1c719f78012c63d1bc98a00163dde0fe4cb567f1382 WatchSource:0}: Error finding container f2df3a324d5d06e89b60b1c719f78012c63d1bc98a00163dde0fe4cb567f1382: Status 404 returned error can't find the container with id f2df3a324d5d06e89b60b1c719f78012c63d1bc98a00163dde0fe4cb567f1382 Jul 17 17:59:35.718889 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:35.718824 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" event={"ID":"83347a28-4a67-4674-999b-78d568289833","Type":"ContainerStarted","Data":"60f59ca0807c4f11085431e19465a77732a5985f1bc0114656336e58fb34a2f0"} Jul 17 17:59:35.719369 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:35.718896 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" event={"ID":"83347a28-4a67-4674-999b-78d568289833","Type":"ContainerStarted","Data":"f2df3a324d5d06e89b60b1c719f78012c63d1bc98a00163dde0fe4cb567f1382"} Jul 17 17:59:35.742007 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:35.738680 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" podStartSLOduration=1.562774844 podStartE2EDuration="1.738659432s" totalImagesPullingTime="175.884588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:59:35.735489922 +0000 UTC m=+610.090341507" watchObservedRunningTime="2026-07-17 17:59:35.738659432 +0000 UTC m=+610.093511015" Jul 17 17:59:36.528801 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:36.528761 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:59:40.906698 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:40.906663 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn"] Jul 17 17:59:40.910190 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:40.910168 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:40.912941 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:40.912919 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 17 17:59:40.920287 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:40.920264 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn"] Jul 17 17:59:41.020270 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.020228 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.020270 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.020274 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.020489 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.020299 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f948t\" (UniqueName: \"kubernetes.io/projected/0db5a915-d634-4f9c-96db-30c453d597ee-kube-api-access-f948t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.020489 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.020385 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.020560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.020498 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db5a915-d634-4f9c-96db-30c453d597ee-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.020560 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.020524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121163 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121122 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121338 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f948t\" (UniqueName: \"kubernetes.io/projected/0db5a915-d634-4f9c-96db-30c453d597ee-kube-api-access-f948t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121338 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121338 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121303 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db5a915-d634-4f9c-96db-30c453d597ee-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121338 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121329 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121493 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121368 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121674 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121655 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121709 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121654 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.121742 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.121722 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.123837 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.123802 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0db5a915-d634-4f9c-96db-30c453d597ee-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.124101 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.124082 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0db5a915-d634-4f9c-96db-30c453d597ee-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.129094 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.129070 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f948t\" (UniqueName: \"kubernetes.io/projected/0db5a915-d634-4f9c-96db-30c453d597ee-kube-api-access-f948t\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn\" (UID: \"0db5a915-d634-4f9c-96db-30c453d597ee\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.219957 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.219833 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:41.359427 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.359365 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn"] Jul 17 17:59:41.362049 ip-10-0-138-33 kubenswrapper[2552]: W0717 17:59:41.361977 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0db5a915_d634_4f9c_96db_30c453d597ee.slice/crio-098d83acfa172f34971919eb2e262fc0cb9f302e7d760a01314dd6f4e33b2963 WatchSource:0}: Error finding container 098d83acfa172f34971919eb2e262fc0cb9f302e7d760a01314dd6f4e33b2963: Status 404 returned error can't find the container with id 098d83acfa172f34971919eb2e262fc0cb9f302e7d760a01314dd6f4e33b2963 Jul 17 17:59:41.363459 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.363440 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 17:59:41.745471 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.745424 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" event={"ID":"0db5a915-d634-4f9c-96db-30c453d597ee","Type":"ContainerStarted","Data":"9ae154ba14d48f962db716ad0ca3f743e3bc31366adbbb908084f1342d74be21"} Jul 17 17:59:41.745471 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.745465 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" event={"ID":"0db5a915-d634-4f9c-96db-30c453d597ee","Type":"ContainerStarted","Data":"098d83acfa172f34971919eb2e262fc0cb9f302e7d760a01314dd6f4e33b2963"} Jul 17 17:59:41.763242 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:41.763188 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" podStartSLOduration=1.5924713129999999 podStartE2EDuration="1.763172s" totalImagesPullingTime="170.700687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:59:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:59:41.761943165 +0000 UTC m=+616.116794746" watchObservedRunningTime="2026-07-17 17:59:41.763172 +0000 UTC m=+616.118023580" Jul 17 17:59:44.627620 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:44.627583 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:44.628123 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:44.627654 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:44.640421 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:44.640396 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:44.732628 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:44.732595 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 17:59:44.771306 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:44.771277 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-8xpcj" Jul 17 17:59:51.221087 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:51.220969 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:51.221087 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:51.221044 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:51.233610 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:51.233575 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 17:59:51.803399 ip-10-0-138-33 kubenswrapper[2552]: I0717 17:59:51.803369 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn" Jul 17 18:01:01.632317 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:01:01.632277 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:01:11.336622 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:01:11.336580 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:01:22.135755 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:01:22.135544 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:03:03.241847 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:03:03.241761 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:03:38.340447 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:03:38.340409 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:03:50.035321 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:03:50.035281 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:04:00.636750 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:04:00.636706 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:04:06.636786 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:04:06.636743 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:04:18.144049 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:04:18.143966 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:04:27.835382 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:04:27.835335 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:04:40.038182 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:04:40.038143 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:04:50.130966 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:04:50.130928 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:05:15.738599 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:05:15.738558 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:05:25.336954 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:05:25.336918 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:05:47.540636 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:05:47.540538 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:05:58.535099 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:05:58.535062 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:06:14.536782 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:06:14.536743 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:06:24.137146 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:06:24.137108 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:06:34.443874 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:06:34.443812 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:06:44.436920 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:06:44.436881 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:06:53.943376 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:06:53.943336 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:08:42.743342 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:08:42.743302 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:08:57.446053 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:08:57.446016 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:09:15.733434 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:09:15.733393 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:09:26.837258 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:09:26.837221 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:09:37.935674 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:09:37.935639 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:09:46.233513 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:09:46.233479 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:09:57.635042 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:09:57.635000 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:10:09.029098 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:10:09.029061 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:10:17.431437 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:10:17.431352 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:10:31.738454 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:10:31.738413 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:10:52.832402 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:10:52.832368 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:11:00.034572 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:11:00.034539 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:11:10.535353 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:11:10.535306 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:11:20.727312 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:11:20.727275 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:11:30.435175 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:11:30.435132 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:11:42.639518 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:11:42.639484 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:11:52.133588 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:11:52.133503 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:12:02.033855 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:12:02.033815 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:12:12.634087 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:12:12.634047 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:12:22.640031 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:12:22.639995 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:12:32.638093 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:12:32.638051 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:12:43.435131 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:12:43.435091 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:13:02.036104 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:13:02.036058 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:13:16.531604 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:13:16.531568 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:13:29.533766 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:13:29.533732 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:13:49.439084 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:13:49.439049 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:14:01.443421 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:01.443370 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:14:10.936143 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:10.936106 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:14:25.837236 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:25.837198 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:14:40.938758 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:40.938719 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:14:46.316895 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.316829 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49"] Jul 17 18:14:46.320879 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.320836 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.323703 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.323674 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-284e9f2b-openshift-default-dockercfg-429hn\"" Jul 17 18:14:46.340212 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.340180 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49"] Jul 17 18:14:46.402055 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402008 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-data\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402240 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402066 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-socket\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402240 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-credential-socket\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402240 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-certs\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402240 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402217 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-envoy\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402410 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402249 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9zmt\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-kube-api-access-g9zmt\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402410 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402316 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4c1881f-84c1-4f12-870f-715a69bf434e-istiod-ca-cert\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402410 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402335 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-token\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.402410 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.402363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-podinfo\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.503632 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503592 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-podinfo\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.503852 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503674 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-data\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.503852 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503705 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-socket\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.503852 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503747 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-credential-socket\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.503852 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503769 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-certs\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.503852 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503805 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-envoy\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.503852 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503828 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9zmt\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-kube-api-access-g9zmt\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.504278 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503913 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4c1881f-84c1-4f12-870f-715a69bf434e-istiod-ca-cert\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.504278 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.503942 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-token\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.504278 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.504182 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-data\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.504278 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.504209 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-certs\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.504494 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.504287 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-credential-socket\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.504494 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.504340 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-socket\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.504796 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.504773 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4c1881f-84c1-4f12-870f-715a69bf434e-istiod-ca-cert\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.506282 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.506264 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-envoy\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.506545 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.506527 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-podinfo\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.512106 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.512079 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-token\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.512245 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.512222 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9zmt\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-kube-api-access-g9zmt\") pod \"e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.633292 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.633197 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:46.775791 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.775761 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49"] Jul 17 18:14:46.778090 ip-10-0-138-33 kubenswrapper[2552]: W0717 18:14:46.778059 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c1881f_84c1_4f12_870f_715a69bf434e.slice/crio-1657a75d06c41200b7716ed5de7b981502d1e1fd3ff32e290b58c0e5cac17b7e WatchSource:0}: Error finding container 1657a75d06c41200b7716ed5de7b981502d1e1fd3ff32e290b58c0e5cac17b7e: Status 404 returned error can't find the container with id 1657a75d06c41200b7716ed5de7b981502d1e1fd3ff32e290b58c0e5cac17b7e Jul 17 18:14:46.780824 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.780791 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:14:46.780938 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.780889 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:14:46.781000 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.780943 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:14:46.904520 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.904425 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" event={"ID":"a4c1881f-84c1-4f12-870f-715a69bf434e","Type":"ContainerStarted","Data":"51407f2d88a88806a2b9ea3d5cd32e6a40e8c616fa46759b6eb9e5d22969c578"} Jul 17 18:14:46.904520 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.904500 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" event={"ID":"a4c1881f-84c1-4f12-870f-715a69bf434e","Type":"ContainerStarted","Data":"1657a75d06c41200b7716ed5de7b981502d1e1fd3ff32e290b58c0e5cac17b7e"} Jul 17 18:14:46.927032 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:46.926943 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" podStartSLOduration=0.92691901 podStartE2EDuration="926.91901ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:14:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:14:46.923010458 +0000 UTC m=+1521.277862039" watchObservedRunningTime="2026-07-17 18:14:46.92691901 +0000 UTC m=+1521.281770592" Jul 17 18:14:47.634296 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:47.634262 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:47.639580 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:47.639549 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:47.909233 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:47.909134 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:47.910337 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:47.910314 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:14:50.636278 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:50.636243 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:14:58.969202 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:58.969167 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerID="51407f2d88a88806a2b9ea3d5cd32e6a40e8c616fa46759b6eb9e5d22969c578" exitCode=0 Jul 17 18:14:58.969628 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:58.969238 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" event={"ID":"a4c1881f-84c1-4f12-870f-715a69bf434e","Type":"ContainerDied","Data":"51407f2d88a88806a2b9ea3d5cd32e6a40e8c616fa46759b6eb9e5d22969c578"} Jul 17 18:14:58.969628 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:58.969618 2552 scope.go:117] "RemoveContainer" containerID="51407f2d88a88806a2b9ea3d5cd32e6a40e8c616fa46759b6eb9e5d22969c578" Jul 17 18:14:58.970558 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:58.970534 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:14:58.970635 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:58.970622 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:14:58.970679 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:58.970657 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:14:59.979972 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:14:59.979937 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" event={"ID":"a4c1881f-84c1-4f12-870f-715a69bf434e","Type":"ContainerStarted","Data":"20e1f36b31fafa506c5c015dc87c42e65cc9566527e0e6d0ad1b5840776131ac"} Jul 17 18:15:00.634087 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:00.634040 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:15:00.635283 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:00.635258 2552 patch_prober.go:28] interesting pod/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 17 18:15:00.635345 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:00.635317 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 17 18:15:01.634527 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:01.634489 2552 patch_prober.go:28] interesting pod/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 17 18:15:01.634952 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:01.634549 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 17 18:15:02.634221 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:02.634181 2552 patch_prober.go:28] interesting pod/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 17 18:15:02.634618 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:02.634238 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 17 18:15:02.909428 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:02.909333 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:15:03.633682 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:03.633635 2552 patch_prober.go:28] interesting pod/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 17 18:15:03.633885 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:03.633713 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 17 18:15:04.637933 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:04.637891 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:15:04.638960 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:15:04.638934 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:17:52.651712 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:52.651626 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49"] Jul 17 18:17:52.652302 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:52.651847 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" containerID="cri-o://20e1f36b31fafa506c5c015dc87c42e65cc9566527e0e6d0ad1b5840776131ac" gracePeriod=30 Jul 17 18:17:55.528937 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:55.528897 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:17:57.820956 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.820923 2552 generic.go:356] "Generic (PLEG): container finished" podID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerID="20e1f36b31fafa506c5c015dc87c42e65cc9566527e0e6d0ad1b5840776131ac" exitCode=0 Jul 17 18:17:57.821329 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.820970 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" event={"ID":"a4c1881f-84c1-4f12-870f-715a69bf434e","Type":"ContainerDied","Data":"20e1f36b31fafa506c5c015dc87c42e65cc9566527e0e6d0ad1b5840776131ac"} Jul 17 18:17:57.821329 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.821025 2552 scope.go:117] "RemoveContainer" containerID="51407f2d88a88806a2b9ea3d5cd32e6a40e8c616fa46759b6eb9e5d22969c578" Jul 17 18:17:57.907319 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.907295 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:17:57.945542 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945452 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-credential-socket\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945542 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945499 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9zmt\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-kube-api-access-g9zmt\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945544 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4c1881f-84c1-4f12-870f-715a69bf434e-istiod-ca-cert\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945596 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-token\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945641 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-podinfo\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945666 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-socket\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945692 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-certs\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945742 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-data\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945767 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-envoy\") pod \"a4c1881f-84c1-4f12-870f-715a69bf434e\" (UID: \"a4c1881f-84c1-4f12-870f-715a69bf434e\") " Jul 17 18:17:57.945851 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.945810 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:57.946294 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.946010 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:57.946294 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.946127 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:57.946294 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.946146 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:57.946294 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.946230 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:57.946729 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.946704 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4c1881f-84c1-4f12-870f-715a69bf434e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:17:57.946930 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.946744 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:57.948700 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.948462 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-kube-api-access-g9zmt" (OuterVolumeSpecName: "kube-api-access-g9zmt") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "kube-api-access-g9zmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:57.948815 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.948708 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:17:57.949051 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.949003 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:17:57.949220 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:57.949195 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4c1881f-84c1-4f12-870f-715a69bf434e" (UID: "a4c1881f-84c1-4f12-870f-715a69bf434e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:17:58.047108 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.047062 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9zmt\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-kube-api-access-g9zmt\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.047108 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.047096 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4c1881f-84c1-4f12-870f-715a69bf434e-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.047108 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.047106 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.047108 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.047114 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.047370 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.047123 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.047370 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.047132 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.047370 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.047140 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4c1881f-84c1-4f12-870f-715a69bf434e-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:17:58.828031 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.828001 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" Jul 17 18:17:58.828459 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.828006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49" event={"ID":"a4c1881f-84c1-4f12-870f-715a69bf434e","Type":"ContainerDied","Data":"1657a75d06c41200b7716ed5de7b981502d1e1fd3ff32e290b58c0e5cac17b7e"} Jul 17 18:17:58.828459 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.828129 2552 scope.go:117] "RemoveContainer" containerID="20e1f36b31fafa506c5c015dc87c42e65cc9566527e0e6d0ad1b5840776131ac" Jul 17 18:17:58.847009 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.846961 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49"] Jul 17 18:17:58.850020 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:17:58.849992 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-284e9f2b-openshift-default-649577f9ff-8kc49"] Jul 17 18:18:00.126992 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:00.126947 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" path="/var/lib/kubelet/pods/a4c1881f-84c1-4f12-870f-715a69bf434e/volumes" Jul 17 18:18:04.712088 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.712044 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7"] Jul 17 18:18:04.712604 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.712583 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" Jul 17 18:18:04.712681 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.712608 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" Jul 17 18:18:04.712734 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.712727 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" Jul 17 18:18:04.712790 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.712739 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" Jul 17 18:18:04.717189 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.717162 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.720104 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.720079 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-db09a830-gw-openshift-default-dockercfg-xh88f\"" Jul 17 18:18:04.731208 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.731180 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7"] Jul 17 18:18:04.805160 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805120 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-socket\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805160 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805161 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-certs\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805385 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805202 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-podinfo\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805385 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-token\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805385 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805338 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-data\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805385 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805375 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istiod-ca-cert\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805512 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805401 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-credential-socket\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805512 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-envoy\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.805512 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.805472 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d292\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-kube-api-access-5d292\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906462 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906420 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-podinfo\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906462 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906466 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-token\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906713 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906508 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-data\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906713 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906533 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istiod-ca-cert\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906713 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906555 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-credential-socket\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906713 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906575 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-envoy\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906713 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906619 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d292\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-kube-api-access-5d292\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906713 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906657 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-socket\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.906713 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.906682 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-certs\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.907110 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.907073 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-data\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.907110 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.907105 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-certs\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.907299 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.907159 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-socket\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.907299 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.907267 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-credential-socket\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.907507 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.907453 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istiod-ca-cert\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.909127 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.909102 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-envoy\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.909127 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.909116 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-podinfo\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.914926 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.914904 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d292\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-kube-api-access-5d292\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:04.915023 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:04.914966 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-token\") pod \"e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:05.029711 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.029673 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:05.175292 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.175261 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7"] Jul 17 18:18:05.176946 ip-10-0-138-33 kubenswrapper[2552]: W0717 18:18:05.176915 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4e4ab8_05f2_4b26_acbd_11cc14d881fe.slice/crio-dfe73bf0ee7e23a0ce6f8c7f25e13074cd041c1b9b74ba55f39d3e8af505a89d WatchSource:0}: Error finding container dfe73bf0ee7e23a0ce6f8c7f25e13074cd041c1b9b74ba55f39d3e8af505a89d: Status 404 returned error can't find the container with id dfe73bf0ee7e23a0ce6f8c7f25e13074cd041c1b9b74ba55f39d3e8af505a89d Jul 17 18:18:05.179340 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.179308 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:18:05.179447 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.179393 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:18:05.179505 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.179442 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:18:05.867350 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.867316 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" event={"ID":"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe","Type":"ContainerStarted","Data":"4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6"} Jul 17 18:18:05.867745 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.867372 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" event={"ID":"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe","Type":"ContainerStarted","Data":"dfe73bf0ee7e23a0ce6f8c7f25e13074cd041c1b9b74ba55f39d3e8af505a89d"} Jul 17 18:18:05.890338 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:05.890281 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" podStartSLOduration=1.890264492 podStartE2EDuration="1.890264492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:18:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:18:05.889570094 +0000 UTC m=+1720.244421674" watchObservedRunningTime="2026-07-17 18:18:05.890264492 +0000 UTC m=+1720.245116072" Jul 17 18:18:06.030607 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:06.030559 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:06.036808 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:06.036777 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:06.872563 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:06.872532 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:06.873520 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:06.873500 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:09.236523 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:09.236481 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:18:16.922186 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:16.922153 2552 generic.go:356] "Generic (PLEG): container finished" podID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerID="4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6" exitCode=0 Jul 17 18:18:16.922607 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:16.922221 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" event={"ID":"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe","Type":"ContainerDied","Data":"4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6"} Jul 17 18:18:16.922607 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:16.922603 2552 scope.go:117] "RemoveContainer" containerID="4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6" Jul 17 18:18:16.923630 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:16.923602 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:18:16.923707 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:16.923689 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:18:16.923744 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:16.923734 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:18:17.928947 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:17.928912 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" event={"ID":"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe","Type":"ContainerStarted","Data":"015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e"} Jul 17 18:18:18.030505 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:18.030467 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:18.031522 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:18.031496 2552 patch_prober.go:28] interesting pod/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 17 18:18:18.031663 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:18.031556 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 17 18:18:19.030254 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:19.030203 2552 patch_prober.go:28] interesting pod/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 17 18:18:19.030650 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:19.030263 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 17 18:18:20.031089 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:20.031049 2552 patch_prober.go:28] interesting pod/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 17 18:18:20.031488 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:20.031120 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 17 18:18:21.030634 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:21.030595 2552 patch_prober.go:28] interesting pod/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 17 18:18:21.030821 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:21.030653 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 17 18:18:21.873401 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:21.873356 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:22.034075 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:22.034044 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:18:22.034923 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:18:22.034906 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:19:10.628142 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:10.628101 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7"] Jul 17 18:19:10.628697 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:10.628324 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" containerID="cri-o://015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e" gracePeriod=30 Jul 17 18:19:13.742248 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:13.742204 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:19:15.895813 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.895741 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:19:15.977808 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.977776 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-token\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.977932 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.977892 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-certs\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.977982 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.977946 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-socket\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.978025 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.977981 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-podinfo\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.978025 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978013 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istiod-ca-cert\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.978121 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978053 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d292\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-kube-api-access-5d292\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.978121 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978090 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-credential-socket\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.978228 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978143 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-envoy\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.978228 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978173 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-data\") pod \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\" (UID: \"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe\") " Jul 17 18:19:15.978331 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978239 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:19:15.978504 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978475 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:19:15.978592 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978548 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:15.978592 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978580 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:19:15.978903 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.978834 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:19:15.979241 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.979213 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:19:15.980480 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.980454 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:19:15.980767 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.980743 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:19:15.980849 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.980814 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-kube-api-access-5d292" (OuterVolumeSpecName: "kube-api-access-5d292") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "kube-api-access-5d292". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:19:15.980849 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:15.980832 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" (UID: "3e4e4ab8-05f2-4b26-acbd-11cc14d881fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:19:16.079235 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079193 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.079235 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079226 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.079235 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079239 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.079487 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079250 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d292\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-kube-api-access-5d292\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.079487 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079262 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.079487 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079273 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.079487 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079284 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.079487 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.079324 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:19:16.205593 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.205506 2552 generic.go:356] "Generic (PLEG): container finished" podID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerID="015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e" exitCode=0 Jul 17 18:19:16.205593 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.205562 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" Jul 17 18:19:16.205796 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.205595 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" event={"ID":"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe","Type":"ContainerDied","Data":"015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e"} Jul 17 18:19:16.205796 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.205655 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7" event={"ID":"3e4e4ab8-05f2-4b26-acbd-11cc14d881fe","Type":"ContainerDied","Data":"dfe73bf0ee7e23a0ce6f8c7f25e13074cd041c1b9b74ba55f39d3e8af505a89d"} Jul 17 18:19:16.205796 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.205679 2552 scope.go:117] "RemoveContainer" containerID="015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e" Jul 17 18:19:16.214375 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.214357 2552 scope.go:117] "RemoveContainer" containerID="4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6" Jul 17 18:19:16.222755 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.222734 2552 scope.go:117] "RemoveContainer" containerID="015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e" Jul 17 18:19:16.223236 ip-10-0-138-33 kubenswrapper[2552]: E0717 18:19:16.223216 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e\": container with ID starting with 015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e not found: ID does not exist" containerID="015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e" Jul 17 18:19:16.223332 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.223245 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e"} err="failed to get container status \"015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e\": rpc error: code = NotFound desc = could not find container \"015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e\": container with ID starting with 015be310858a84fa615ac3e4a20eeb58549a25c305371a3a925f2b0ef243239e not found: ID does not exist" Jul 17 18:19:16.223332 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.223267 2552 scope.go:117] "RemoveContainer" containerID="4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6" Jul 17 18:19:16.223332 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.223313 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7"] Jul 17 18:19:16.223500 ip-10-0-138-33 kubenswrapper[2552]: E0717 18:19:16.223484 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6\": container with ID starting with 4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6 not found: ID does not exist" containerID="4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6" Jul 17 18:19:16.223536 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.223505 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6"} err="failed to get container status \"4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6\": rpc error: code = NotFound desc = could not find container \"4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6\": container with ID starting with 4e5a23d3e56b4e16bbcaa8b4f38b85bddad320106137c1913e31a3942955fac6 not found: ID does not exist" Jul 17 18:19:16.231823 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:16.231797 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-db09a830-gw-openshift-default-5db7574447-29gr7"] Jul 17 18:19:18.127409 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:18.127366 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" path="/var/lib/kubelet/pods/3e4e4ab8-05f2-4b26-acbd-11cc14d881fe/volumes" Jul 17 18:19:22.635005 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.634968 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c"] Jul 17 18:19:22.635529 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.635510 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" Jul 17 18:19:22.635576 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.635535 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4c1881f-84c1-4f12-870f-715a69bf434e" containerName="istio-proxy" Jul 17 18:19:22.635576 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.635554 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" Jul 17 18:19:22.635576 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.635562 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" Jul 17 18:19:22.635687 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.635674 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" Jul 17 18:19:22.640683 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.640654 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.648535 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.648513 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ad85eda1-openshift-default-dockercfg-9lfb9\"" Jul 17 18:19:22.672392 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.672360 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c"] Jul 17 18:19:22.736590 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xvbz\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-kube-api-access-6xvbz\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.736590 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-socket\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.736831 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736616 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-certs\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.736831 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736674 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-data\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.736831 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736721 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-token\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.736831 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736746 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-envoy\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.736831 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736769 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cefe5346-1e9e-4abc-897c-27c23a5eb609-istiod-ca-cert\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.736831 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736818 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-podinfo\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.737095 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.736857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-credential-socket\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.837799 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.837754 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xvbz\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-kube-api-access-6xvbz\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.837799 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.837800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-socket\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838090 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.837818 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-certs\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838090 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.837834 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-data\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838090 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.837888 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-token\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838090 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.837926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-envoy\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838090 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.837968 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cefe5346-1e9e-4abc-897c-27c23a5eb609-istiod-ca-cert\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838090 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.838000 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-podinfo\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838090 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.838032 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-credential-socket\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838409 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.838360 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-data\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838467 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.838424 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-certs\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838467 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.838435 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-credential-socket\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838557 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.838508 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-socket\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.838660 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.838640 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cefe5346-1e9e-4abc-897c-27c23a5eb609-istiod-ca-cert\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.840595 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.840575 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-envoy\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.840714 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.840696 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-podinfo\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.846428 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.846399 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-token\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.846534 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.846458 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xvbz\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-kube-api-access-6xvbz\") pod \"e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:22.951988 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:22.951870 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:23.117846 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.117813 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c"] Jul 17 18:19:23.119265 ip-10-0-138-33 kubenswrapper[2552]: W0717 18:19:23.119237 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcefe5346_1e9e_4abc_897c_27c23a5eb609.slice/crio-5910671a2876af0ef2dfcb17ed4bd529c305632f914a27fe2e9107c66575e6ef WatchSource:0}: Error finding container 5910671a2876af0ef2dfcb17ed4bd529c305632f914a27fe2e9107c66575e6ef: Status 404 returned error can't find the container with id 5910671a2876af0ef2dfcb17ed4bd529c305632f914a27fe2e9107c66575e6ef Jul 17 18:19:23.121365 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.121329 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:19:23.121464 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.121421 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:19:23.121531 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.121465 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:19:23.243198 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.243097 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" event={"ID":"cefe5346-1e9e-4abc-897c-27c23a5eb609","Type":"ContainerStarted","Data":"728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8"} Jul 17 18:19:23.243198 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.243154 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" event={"ID":"cefe5346-1e9e-4abc-897c-27c23a5eb609","Type":"ContainerStarted","Data":"5910671a2876af0ef2dfcb17ed4bd529c305632f914a27fe2e9107c66575e6ef"} Jul 17 18:19:23.262954 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.262892 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podStartSLOduration=1.262850695 podStartE2EDuration="1.262850695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:19:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:19:23.260626842 +0000 UTC m=+1797.615478422" watchObservedRunningTime="2026-07-17 18:19:23.262850695 +0000 UTC m=+1797.617702276" Jul 17 18:19:23.952552 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:23.952516 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:24.958412 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:24.958370 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:25.253276 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:25.253157 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:25.254193 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:25.254173 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:31.531406 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:31.531370 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:19:40.255314 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.255266 2552 patch_prober.go:28] interesting pod/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:19:40.255821 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.255347 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 17 18:19:40.322331 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.322298 2552 generic.go:356] "Generic (PLEG): container finished" podID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerID="728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8" exitCode=0 Jul 17 18:19:40.322539 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.322347 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" event={"ID":"cefe5346-1e9e-4abc-897c-27c23a5eb609","Type":"ContainerDied","Data":"728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8"} Jul 17 18:19:40.322772 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.322752 2552 scope.go:117] "RemoveContainer" containerID="728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8" Jul 17 18:19:40.323820 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.323790 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:19:40.323952 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.323904 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:19:40.324012 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:40.323979 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jul 17 18:19:41.329140 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:41.329107 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" event={"ID":"cefe5346-1e9e-4abc-897c-27c23a5eb609","Type":"ContainerStarted","Data":"b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd"} Jul 17 18:19:41.952856 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:41.952810 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:41.953202 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:41.953101 2552 patch_prober.go:28] interesting pod/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:19:41.953202 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:41.953165 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 17 18:19:42.952388 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:42.952345 2552 patch_prober.go:28] interesting pod/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:19:42.952925 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:42.952417 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 17 18:19:43.953028 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:43.952977 2552 patch_prober.go:28] interesting pod/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:19:43.953548 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:43.953068 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 17 18:19:44.952522 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:44.952470 2552 patch_prober.go:28] interesting pod/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 17 18:19:44.952748 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:44.952557 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 17 18:19:45.956844 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:45.956808 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:45.957244 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:45.957228 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:19:45.957843 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:19:45.957821 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:25:29.239941 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:29.239902 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c"] Jul 17 18:25:29.240484 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:29.240115 2552 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" containerID="cri-o://b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd" gracePeriod=30 Jul 17 18:25:30.960158 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:30.960121 2552 patch_prober.go:28] interesting pod/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 17 18:25:30.960565 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:30.960191 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 17 18:25:32.329207 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:32.329168 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-j9ccc"] Jul 17 18:25:34.489151 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.489122 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:25:34.551842 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.551795 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-podinfo\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552051 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.551874 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-certs\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552051 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.551908 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-envoy\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552051 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.551956 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cefe5346-1e9e-4abc-897c-27c23a5eb609-istiod-ca-cert\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552051 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.551997 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-credential-socket\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552051 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.552026 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-socket\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552306 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.552054 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xvbz\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-kube-api-access-6xvbz\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552306 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.552091 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-token\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552306 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.552153 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-data\") pod \"cefe5346-1e9e-4abc-897c-27c23a5eb609\" (UID: \"cefe5346-1e9e-4abc-897c-27c23a5eb609\") " Jul 17 18:25:34.552306 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.552180 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:25:34.552480 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.552438 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-certs\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.552848 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.552744 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:25:34.553113 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.553081 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cefe5346-1e9e-4abc-897c-27c23a5eb609-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 18:25:34.554370 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.554344 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 17 18:25:34.554550 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.554514 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-data" (OuterVolumeSpecName: "istio-data") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:25:34.554550 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.554531 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:25:34.554953 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.554851 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-kube-api-access-6xvbz" (OuterVolumeSpecName: "kube-api-access-6xvbz") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "kube-api-access-6xvbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:25:34.555035 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.554980 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 18:25:34.556236 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.556210 2552 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-token" (OuterVolumeSpecName: "istio-token") pod "cefe5346-1e9e-4abc-897c-27c23a5eb609" (UID: "cefe5346-1e9e-4abc-897c-27c23a5eb609"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 18:25:34.653367 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653324 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-credential-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.653367 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653359 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-workload-socket\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.653367 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653372 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xvbz\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-kube-api-access-6xvbz\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.653611 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653384 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.653611 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653396 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-data\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.653611 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653407 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-podinfo\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.653611 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653416 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cefe5346-1e9e-4abc-897c-27c23a5eb609-istio-envoy\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.653611 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.653426 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cefe5346-1e9e-4abc-897c-27c23a5eb609-istiod-ca-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jul 17 18:25:34.967991 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.967892 2552 generic.go:356] "Generic (PLEG): container finished" podID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerID="b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd" exitCode=0 Jul 17 18:25:34.967991 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.967967 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" event={"ID":"cefe5346-1e9e-4abc-897c-27c23a5eb609","Type":"ContainerDied","Data":"b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd"} Jul 17 18:25:34.968221 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.967996 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" Jul 17 18:25:34.968221 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.968024 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c" event={"ID":"cefe5346-1e9e-4abc-897c-27c23a5eb609","Type":"ContainerDied","Data":"5910671a2876af0ef2dfcb17ed4bd529c305632f914a27fe2e9107c66575e6ef"} Jul 17 18:25:34.968221 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.968054 2552 scope.go:117] "RemoveContainer" containerID="b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd" Jul 17 18:25:34.977446 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.977424 2552 scope.go:117] "RemoveContainer" containerID="728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8" Jul 17 18:25:34.986277 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.986253 2552 scope.go:117] "RemoveContainer" containerID="b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd" Jul 17 18:25:34.986580 ip-10-0-138-33 kubenswrapper[2552]: E0717 18:25:34.986558 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd\": container with ID starting with b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd not found: ID does not exist" containerID="b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd" Jul 17 18:25:34.986650 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.986593 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd"} err="failed to get container status \"b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd\": rpc error: code = NotFound desc = could not find container \"b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd\": container with ID starting with b651ff2c5d70a1c600ac68bc13a832b4e66e074ee08135e40aa8372dd64280fd not found: ID does not exist" Jul 17 18:25:34.986650 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.986617 2552 scope.go:117] "RemoveContainer" containerID="728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8" Jul 17 18:25:34.986887 ip-10-0-138-33 kubenswrapper[2552]: E0717 18:25:34.986855 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8\": container with ID starting with 728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8 not found: ID does not exist" containerID="728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8" Jul 17 18:25:34.986931 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.986895 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8"} err="failed to get container status \"728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8\": rpc error: code = NotFound desc = could not find container \"728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8\": container with ID starting with 728f61f79527f7c7a6ec3b96c325fde2f59c0d1f109f8a9cab79cdfe54c0afd8 not found: ID does not exist" Jul 17 18:25:34.989797 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.989775 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c"] Jul 17 18:25:34.994029 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:34.994003 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ad85eda1-openshift-default-6d4566f84f-9gl6c"] Jul 17 18:25:36.126982 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:36.126951 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" path="/var/lib/kubelet/pods/cefe5346-1e9e-4abc-897c-27c23a5eb609/volumes" Jul 17 18:25:46.420380 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:46.420352 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mhmxz_b5d043bf-d856-4682-8486-a3b65c601c44/manager/0.log" Jul 17 18:25:46.532565 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:46.532536 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z27dj_6562fb12-4c44-4415-a4e9-57db5e6e5fd7/manager/0.log" Jul 17 18:25:46.783425 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:46.783397 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wkt5h_87a0829b-2c60-4132-be07-8bd3277129b5/server/0.log" Jul 17 18:25:46.896658 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:46.896624 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2hn2x_6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51/manager/0.log" Jul 17 18:25:47.245224 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:47.245148 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-v2zc5_c22a27ae-df66-494d-a321-34afd5e7a187/copy-manifests/0.log" Jul 17 18:25:47.251216 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:47.251196 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-v2zc5_c22a27ae-df66-494d-a321-34afd5e7a187/manager/0.log" Jul 17 18:25:49.369018 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:49.368983 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7n5rj_be19b857-3f50-4b7f-a265-4f4a27f4c17b/manager/0.log" Jul 17 18:25:49.477216 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:49.477186 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-b8gjc_7a5e1277-cbbe-4362-95ed-5afda5877dfe/manager/0.log" Jul 17 18:25:49.581965 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:49.581936 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4sj78_72c98c27-42fa-426b-80bf-fc1f8215a293/kuadrant-console-plugin/0.log" Jul 17 18:25:49.696958 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:49.696845 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r6zxw_f0a0822a-b481-4056-9b69-85931e33866e/registry-server/0.log" Jul 17 18:25:49.950092 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:49.950017 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j9ccc_752f5730-b550-4cf4-85fe-fbd206b0c344/limitador/0.log" Jul 17 18:25:50.071611 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:50.071580 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mjzwm_969a6d08-218f-4e73-88bd-d70e7e4b68f0/manager/0.log" Jul 17 18:25:50.419668 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:50.419635 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45zwv7_4c8c8972-da98-4d3e-b15f-1e60400712bb/istio-proxy/0.log" Jul 17 18:25:50.654771 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:50.654724 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6799b9db4b-k46vt_ad9b4441-bd66-49b4-abb5-7e9402abf206/kube-auth-proxy/0.log" Jul 17 18:25:50.886266 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:50.886232 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-d2cnv_08958026-8da8-49d8-858b-52053601bb48/istio-proxy/1.log" Jul 17 18:25:51.832823 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:51.832796 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tz6cg_fa3ad60f-61c2-4f8c-a0c2-9e64e6eefb64/main/0.log" Jul 17 18:25:52.062217 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:52.062187 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-8xpcj_83347a28-4a67-4674-999b-78d568289833/main/0.log" Jul 17 18:25:52.171904 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:25:52.171796 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-lcrfn_0db5a915-d634-4f9c-96db-30c453d597ee/main/0.log" Jul 17 18:26:00.841609 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:00.841570 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5vt46_293c10fa-e12e-4eae-a937-5a2f26cac6d7/global-pull-secret-syncer/0.log" Jul 17 18:26:01.009028 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:01.008996 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vqpx4_82b9c982-255e-4782-b917-85ccca03653e/konnectivity-agent/0.log" Jul 17 18:26:01.060141 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:01.060105 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-33.ec2.internal_31783b4ed77dfc64030a66f386750024/haproxy/0.log" Jul 17 18:26:06.308964 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:06.308934 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7n5rj_be19b857-3f50-4b7f-a265-4f4a27f4c17b/manager/0.log" Jul 17 18:26:06.332829 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:06.332798 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-b8gjc_7a5e1277-cbbe-4362-95ed-5afda5877dfe/manager/0.log" Jul 17 18:26:06.364973 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:06.364942 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-4sj78_72c98c27-42fa-426b-80bf-fc1f8215a293/kuadrant-console-plugin/0.log" Jul 17 18:26:06.412122 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:06.412094 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-r6zxw_f0a0822a-b481-4056-9b69-85931e33866e/registry-server/0.log" Jul 17 18:26:06.556081 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:06.556053 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-j9ccc_752f5730-b550-4cf4-85fe-fbd206b0c344/limitador/0.log" Jul 17 18:26:06.609487 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:06.609405 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mjzwm_969a6d08-218f-4e73-88bd-d70e7e4b68f0/manager/0.log" Jul 17 18:26:08.786170 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:08.786142 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gz4bq_8f6dd0d9-b59b-47fa-b868-c5328a981449/node-exporter/0.log" Jul 17 18:26:08.807134 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:08.807103 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gz4bq_8f6dd0d9-b59b-47fa-b868-c5328a981449/kube-rbac-proxy/0.log" Jul 17 18:26:08.835329 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:08.835305 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gz4bq_8f6dd0d9-b59b-47fa-b868-c5328a981449/init-textfile/0.log" Jul 17 18:26:11.769592 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.769555 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv"] Jul 17 18:26:11.770008 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.769933 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" Jul 17 18:26:11.770008 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.769946 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" Jul 17 18:26:11.770008 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.769956 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" Jul 17 18:26:11.770008 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.769962 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" Jul 17 18:26:11.770008 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.769970 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" Jul 17 18:26:11.770008 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.769975 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" Jul 17 18:26:11.770191 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.770032 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e4e4ab8-05f2-4b26-acbd-11cc14d881fe" containerName="istio-proxy" Jul 17 18:26:11.770191 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.770040 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" Jul 17 18:26:11.770191 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.770045 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="cefe5346-1e9e-4abc-897c-27c23a5eb609" containerName="istio-proxy" Jul 17 18:26:11.773040 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.773021 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.776121 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.776098 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wdmc6\"/\"openshift-service-ca.crt\"" Jul 17 18:26:11.776121 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.776115 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wdmc6\"/\"kube-root-ca.crt\"" Jul 17 18:26:11.777126 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.777103 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wdmc6\"/\"default-dockercfg-87g6t\"" Jul 17 18:26:11.781303 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.781273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-lib-modules\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.781433 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.781318 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-sys\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.781433 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.781348 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2klpv\" (UniqueName: \"kubernetes.io/projected/625d30bf-755d-4ec0-8e76-c50120d9e4db-kube-api-access-2klpv\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.781433 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.781387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-podres\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.781549 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.781441 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-proc\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.783106 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.783082 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv"] Jul 17 18:26:11.882506 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882462 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-lib-modules\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882506 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882499 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-sys\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882775 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882518 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2klpv\" (UniqueName: \"kubernetes.io/projected/625d30bf-755d-4ec0-8e76-c50120d9e4db-kube-api-access-2klpv\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882775 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882554 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-podres\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882775 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882595 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-proc\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882775 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882605 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-sys\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882775 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882664 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-proc\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882775 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882675 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-lib-modules\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.882775 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.882683 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/625d30bf-755d-4ec0-8e76-c50120d9e4db-podres\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:11.890915 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:11.890888 2552 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2klpv\" (UniqueName: \"kubernetes.io/projected/625d30bf-755d-4ec0-8e76-c50120d9e4db-kube-api-access-2klpv\") pod \"perf-node-gather-daemonset-h7rzv\" (UID: \"625d30bf-755d-4ec0-8e76-c50120d9e4db\") " pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:12.084755 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:12.084659 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:12.224560 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:12.224525 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv"] Jul 17 18:26:12.226964 ip-10-0-138-33 kubenswrapper[2552]: W0717 18:26:12.226928 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod625d30bf_755d_4ec0_8e76_c50120d9e4db.slice/crio-7a0e5016f202515dfa5a2014210cb62a977e4f7d5a0c5a8b5fb1c5942926857c WatchSource:0}: Error finding container 7a0e5016f202515dfa5a2014210cb62a977e4f7d5a0c5a8b5fb1c5942926857c: Status 404 returned error can't find the container with id 7a0e5016f202515dfa5a2014210cb62a977e4f7d5a0c5a8b5fb1c5942926857c Jul 17 18:26:13.155599 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:13.155561 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" event={"ID":"625d30bf-755d-4ec0-8e76-c50120d9e4db","Type":"ContainerStarted","Data":"3a33bc563b54412a156541a4b2ae3369afc1dbe0f4374ff2468bea96c3ca9ce5"} Jul 17 18:26:13.156027 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:13.155621 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" event={"ID":"625d30bf-755d-4ec0-8e76-c50120d9e4db","Type":"ContainerStarted","Data":"7a0e5016f202515dfa5a2014210cb62a977e4f7d5a0c5a8b5fb1c5942926857c"} Jul 17 18:26:13.156027 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:13.155654 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:13.172708 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:13.172651 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" podStartSLOduration=2.172633906 podStartE2EDuration="2.172633906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:13.170806657 +0000 UTC m=+2207.525658237" watchObservedRunningTime="2026-07-17 18:26:13.172633906 +0000 UTC m=+2207.527485485" Jul 17 18:26:13.783393 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:13.783359 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qchpg_02f8f280-7e28-4ba5-a187-e36cd2d0d099/dns/0.log" Jul 17 18:26:13.802136 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:13.802109 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qchpg_02f8f280-7e28-4ba5-a187-e36cd2d0d099/kube-rbac-proxy/0.log" Jul 17 18:26:13.872006 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:13.871978 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7zggz_b3309a02-8972-48d1-9a5e-444ca7372c65/dns-node-resolver/0.log" Jul 17 18:26:14.462734 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:14.462693 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-576bc9bd84-c6kb6_e1d0b725-9858-48d7-88cd-37e3cd705459/registry/0.log" Jul 17 18:26:14.505744 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:14.505712 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q68qj_80645c97-ff4e-44d9-aaf6-60443de654fb/node-ca/0.log" Jul 17 18:26:15.455000 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:15.454967 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45zwv7_4c8c8972-da98-4d3e-b15f-1e60400712bb/istio-proxy/0.log" Jul 17 18:26:15.547043 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:15.547013 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6799b9db4b-k46vt_ad9b4441-bd66-49b4-abb5-7e9402abf206/kube-auth-proxy/0.log" Jul 17 18:26:15.603267 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:15.603232 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-d2cnv_08958026-8da8-49d8-858b-52053601bb48/istio-proxy/0.log" Jul 17 18:26:15.634309 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:15.634274 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-d2cnv_08958026-8da8-49d8-858b-52053601bb48/istio-proxy/1.log" Jul 17 18:26:16.379425 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:16.379397 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlhxt_490bc3e2-9faf-4468-b685-73439896a055/serve-healthcheck-canary/0.log" Jul 17 18:26:16.910787 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:16.910763 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-426kp_54f90a91-768c-4f1b-8740-4fd0eb7cf225/kube-rbac-proxy/0.log" Jul 17 18:26:16.931963 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:16.931934 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-426kp_54f90a91-768c-4f1b-8740-4fd0eb7cf225/exporter/0.log" Jul 17 18:26:16.951721 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:16.951693 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-426kp_54f90a91-768c-4f1b-8740-4fd0eb7cf225/extractor/0.log" Jul 17 18:26:19.171100 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:19.171073 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wdmc6/perf-node-gather-daemonset-h7rzv" Jul 17 18:26:19.199670 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:19.199638 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mhmxz_b5d043bf-d856-4682-8486-a3b65c601c44/manager/0.log" Jul 17 18:26:19.282730 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:19.282694 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-z27dj_6562fb12-4c44-4415-a4e9-57db5e6e5fd7/manager/0.log" Jul 17 18:26:19.375526 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:19.375493 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-wkt5h_87a0829b-2c60-4132-be07-8bd3277129b5/server/0.log" Jul 17 18:26:19.426619 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:19.426543 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2hn2x_6ad9848d-0a8c-4df4-9c7f-98bd57e9fa51/manager/0.log" Jul 17 18:26:19.580784 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:19.580752 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-v2zc5_c22a27ae-df66-494d-a321-34afd5e7a187/manager/0.log" Jul 17 18:26:19.599572 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:19.599546 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-cc99fdf4f-v2zc5_c22a27ae-df66-494d-a321-34afd5e7a187/copy-manifests/0.log" Jul 17 18:26:22.530110 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:22.530081 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45zwv7_4c8c8972-da98-4d3e-b15f-1e60400712bb/istio-proxy/0.log" Jul 17 18:26:22.599309 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:22.599268 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6799b9db4b-k46vt_ad9b4441-bd66-49b4-abb5-7e9402abf206/kube-auth-proxy/0.log" Jul 17 18:26:22.634473 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:22.634443 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-d2cnv_08958026-8da8-49d8-858b-52053601bb48/istio-proxy/0.log" Jul 17 18:26:22.663734 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:22.663691 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-d2cnv_08958026-8da8-49d8-858b-52053601bb48/istio-proxy/1.log" Jul 17 18:26:23.897959 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:23.897925 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45zwv7_4c8c8972-da98-4d3e-b15f-1e60400712bb/istio-proxy/0.log" Jul 17 18:26:23.971948 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:23.971920 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6799b9db4b-k46vt_ad9b4441-bd66-49b4-abb5-7e9402abf206/kube-auth-proxy/0.log" Jul 17 18:26:24.010262 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:24.010231 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-d2cnv_08958026-8da8-49d8-858b-52053601bb48/istio-proxy/0.log" Jul 17 18:26:24.041619 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:24.041578 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-d2cnv_08958026-8da8-49d8-858b-52053601bb48/istio-proxy/1.log" Jul 17 18:26:27.848583 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:27.848552 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52tzf_b9d79024-5b82-4116-9f69-d76f36c7b0ee/kube-multus-additional-cni-plugins/0.log" Jul 17 18:26:27.869995 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:27.869959 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52tzf_b9d79024-5b82-4116-9f69-d76f36c7b0ee/egress-router-binary-copy/0.log" Jul 17 18:26:27.889116 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:27.889083 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52tzf_b9d79024-5b82-4116-9f69-d76f36c7b0ee/cni-plugins/0.log" Jul 17 18:26:27.907993 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:27.907953 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52tzf_b9d79024-5b82-4116-9f69-d76f36c7b0ee/bond-cni-plugin/0.log" Jul 17 18:26:27.926299 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:27.926273 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52tzf_b9d79024-5b82-4116-9f69-d76f36c7b0ee/routeoverride-cni/0.log" Jul 17 18:26:27.944600 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:27.944572 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52tzf_b9d79024-5b82-4116-9f69-d76f36c7b0ee/whereabouts-cni-bincopy/0.log" Jul 17 18:26:27.963517 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:27.963440 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-52tzf_b9d79024-5b82-4116-9f69-d76f36c7b0ee/whereabouts-cni/0.log" Jul 17 18:26:28.340054 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:28.340024 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f698w_9d7a696b-d2cb-435a-b96f-d4689a611561/kube-multus/0.log" Jul 17 18:26:28.431015 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:28.430983 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-krdns_f5954494-0d8d-49e0-83bd-c538159c1142/network-metrics-daemon/0.log" Jul 17 18:26:28.448358 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:28.448332 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-krdns_f5954494-0d8d-49e0-83bd-c538159c1142/kube-rbac-proxy/0.log" Jul 17 18:26:29.348231 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.348204 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/ovn-controller/0.log" Jul 17 18:26:29.364403 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.364377 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/ovn-acl-logging/0.log" Jul 17 18:26:29.383914 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.383886 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/kube-rbac-proxy-node/0.log" Jul 17 18:26:29.403315 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.403284 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 18:26:29.421604 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.421579 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/northd/0.log" Jul 17 18:26:29.440028 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.440002 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/nbdb/0.log" Jul 17 18:26:29.458119 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.458093 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/sbdb/0.log" Jul 17 18:26:29.503667 ip-10-0-138-33 kubenswrapper[2552]: I0717 18:26:29.503629 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-btzx5_6382d403-d5f4-41ab-b0e6-2087ebf9d4a4/ovnkube-controller/0.log"