Nov 03 19:48:13.540847 ip-10-0-131-64 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 03 19:48:13.540859 ip-10-0-131-64 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 03 19:48:13.540865 ip-10-0-131-64 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 03 19:48:13.541075 ip-10-0-131-64 systemd[1]: Failed to start Kubernetes Kubelet. Nov 03 19:48:24.780110 ip-10-0-131-64 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 03 19:48:24.780126 ip-10-0-131-64 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6891a63df596472c9949cbc83eb27645 -- Nov 03 19:50:10.307197 ip-10-0-131-64 systemd[1]: Starting Kubernetes Kubelet... Nov 03 19:50:10.697176 ip-10-0-131-64 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:10.697176 ip-10-0-131-64 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 19:50:10.697176 ip-10-0-131-64 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:10.697176 ip-10-0-131-64 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:10.701407 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701332 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.701407 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701408 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701413 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701416 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701419 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701422 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701425 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701428 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701430 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701433 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701436 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701438 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701441 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701444 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701447 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701449 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701451 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701454 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701456 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701459 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701461 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.701470 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701464 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701466 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701468 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701472 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701484 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701487 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701490 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701492 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701494 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701497 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701499 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701501 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701504 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701506 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701508 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701511 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701513 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701515 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701518 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.701911 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701520 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701523 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701525 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701527 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701530 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701532 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701535 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701537 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701539 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701541 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701544 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701546 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701548 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701551 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701553 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701556 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701559 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701561 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701569 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701571 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.702357 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701574 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701576 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701579 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701581 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701584 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701586 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701588 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701591 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701593 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701597 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701602 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701605 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701607 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701611 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701613 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701616 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701618 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701621 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701624 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701627 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.702823 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701629 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701632 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701634 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701637 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701639 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701642 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701644 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701647 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701650 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701652 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701655 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701662 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701665 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701668 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701670 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701673 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701675 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701678 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701680 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701682 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.703286 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701685 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701687 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701690 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701693 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701695 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.701697 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702423 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702429 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702432 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702436 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702438 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702440 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702443 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702446 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702449 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702451 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702454 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702456 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702459 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702461 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.703791 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702464 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702466 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702469 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702471 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702474 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702477 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702479 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702482 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702484 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702487 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702489 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702492 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702494 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702497 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702499 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702502 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702504 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702507 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702509 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.704270 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702511 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702514 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702517 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702519 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702521 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702524 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702527 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702530 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702532 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702536 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702540 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702544 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702548 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702551 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702555 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702558 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702561 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702563 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702566 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.704919 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702569 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702572 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702574 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702576 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702579 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702581 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702584 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702586 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702588 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702591 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702593 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702595 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702598 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702600 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702603 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702605 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702607 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702610 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702613 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702615 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.705398 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702617 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702620 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702622 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702625 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702627 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702631 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702634 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702636 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702638 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702641 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702643 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702646 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702650 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702653 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702655 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702658 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702660 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702663 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702665 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702667 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.705895 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702670 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702672 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702674 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702677 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702679 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702682 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702684 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702687 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702689 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702692 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702700 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702703 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702705 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.702707 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703192 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703197 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703200 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703203 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703205 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703208 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.706615 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703210 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703213 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703216 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703218 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703221 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703223 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703226 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703228 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703231 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703233 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703236 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703238 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703241 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703243 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703245 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703248 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703250 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703253 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703255 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703257 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.707091 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703260 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703262 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703265 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703268 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703270 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703273 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703275 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703278 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703280 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703283 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703285 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703288 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703290 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703293 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703295 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703298 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703300 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703303 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703305 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703308 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.707556 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703310 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703312 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703315 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703317 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703320 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703322 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703324 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703327 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703329 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703332 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703335 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703337 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703340 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703342 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703345 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703347 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703349 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703352 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703354 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703356 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.708039 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703359 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703361 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703364 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703366 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703368 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703370 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703374 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703377 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703380 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703382 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703385 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703387 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703390 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703392 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703395 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703397 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703399 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703401 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703404 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.708505 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703406 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703408 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703410 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703413 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703415 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703420 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703422 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703425 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703427 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703429 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703432 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703434 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703437 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703440 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703444 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703447 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703450 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703452 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703455 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.708982 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703457 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.703460 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704308 2571 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704321 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704329 2571 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704334 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704338 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704341 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704345 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704349 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704352 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704355 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704359 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704362 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704365 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704367 2571 flags.go:64] FLAG: --cgroup-root="" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704370 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704373 2571 flags.go:64] FLAG: --client-ca-file="" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704378 2571 flags.go:64] FLAG: --cloud-provider="external" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704381 2571 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704384 2571 flags.go:64] FLAG: --cluster-domain="" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704387 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704390 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704393 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 19:50:10.709423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704396 2571 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704399 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704402 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704407 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704410 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704413 2571 flags.go:64] FLAG: --contention-profiling="false" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704416 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704418 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704421 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704424 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704428 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704431 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704433 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704436 2571 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704440 2571 flags.go:64] FLAG: --enable-server="true" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.704443 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705850 2571 flags.go:64] FLAG: --event-burst="100" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705856 2571 flags.go:64] FLAG: --event-qps="50" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705859 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705863 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705866 2571 flags.go:64] FLAG: --eviction-hard="" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705872 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705875 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705879 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705886 2571 flags.go:64] FLAG: --eviction-soft="" Nov 03 19:50:10.709980 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705890 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705894 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705898 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705901 2571 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705905 2571 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705908 2571 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705911 2571 flags.go:64] FLAG: --feature-gates="" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705918 2571 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705921 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705938 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705942 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705946 2571 flags.go:64] FLAG: --healthz-port="10248" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705949 2571 flags.go:64] FLAG: --help="false" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705952 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705956 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705959 2571 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705964 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705968 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705972 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705975 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705979 2571 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705982 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705994 2571 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 19:50:10.710579 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.705998 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706003 2571 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706006 2571 flags.go:64] FLAG: --kube-reserved="" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706009 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706012 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706015 2571 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706019 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706021 2571 flags.go:64] FLAG: --lock-file="" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706024 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706027 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706033 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706039 2571 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706042 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706045 2571 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706048 2571 flags.go:64] FLAG: --logging-format="text" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706051 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706055 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706057 2571 flags.go:64] FLAG: --manifest-url="" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706063 2571 flags.go:64] FLAG: --manifest-url-header="" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706068 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706071 2571 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706075 2571 flags.go:64] FLAG: --max-pods="110" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706078 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706081 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706084 2571 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 19:50:10.711125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706087 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706090 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706096 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706100 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706108 2571 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706111 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706114 2571 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706118 2571 flags.go:64] FLAG: --pod-cidr="" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706121 2571 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706127 2571 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706130 2571 flags.go:64] FLAG: --pods-per-core="0" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706133 2571 flags.go:64] FLAG: --port="10250" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706135 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706138 2571 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0c17e1e84ca8d6317" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706142 2571 flags.go:64] FLAG: --qos-reserved="" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706144 2571 flags.go:64] FLAG: --read-only-port="10255" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706147 2571 flags.go:64] FLAG: --register-node="true" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706153 2571 flags.go:64] FLAG: --register-with-taints="" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706157 2571 flags.go:64] FLAG: --registry-burst="10" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706160 2571 flags.go:64] FLAG: --registry-qps="5" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706163 2571 flags.go:64] FLAG: --reserved-cpus="" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706166 2571 flags.go:64] FLAG: --reserved-memory="" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706170 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706173 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706176 2571 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706179 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 19:50:10.711699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706185 2571 flags.go:64] FLAG: --runonce="false" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706188 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706191 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706194 2571 flags.go:64] FLAG: --seccomp-default="false" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706197 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706200 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706203 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706206 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706212 2571 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706215 2571 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706218 2571 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706220 2571 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706223 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706226 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706230 2571 flags.go:64] FLAG: --system-cgroups="" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706232 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706241 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706244 2571 flags.go:64] FLAG: --tls-cert-file="" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706247 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706251 2571 flags.go:64] FLAG: --tls-min-version="" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706254 2571 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706257 2571 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706261 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706263 2571 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706269 2571 flags.go:64] FLAG: --v="2" Nov 03 19:50:10.712343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706273 2571 flags.go:64] FLAG: --version="false" Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706277 2571 flags.go:64] FLAG: --vmodule="" Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706282 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.706285 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706684 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706832 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706845 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706850 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706854 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706859 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706863 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706867 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706871 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706878 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706882 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706885 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706889 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706893 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706898 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706902 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.712936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706906 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706911 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706921 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706940 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706944 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706948 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706953 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706957 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706960 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706965 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706969 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706972 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706976 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706980 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706984 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706988 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706993 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.706997 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707000 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707004 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.713537 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707009 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707012 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707016 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707020 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707025 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707029 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707033 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707037 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707041 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707045 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707049 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707053 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707056 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707058 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707061 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707064 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707066 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707069 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707071 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707074 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.714031 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707079 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707083 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707085 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707088 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707091 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707094 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707097 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707100 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707103 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707105 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707108 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707111 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707113 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707116 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707120 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707122 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707125 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707127 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707131 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.714491 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707134 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707138 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707140 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707143 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707145 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707147 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707150 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707153 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707157 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707159 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707162 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707164 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707167 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707170 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707173 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707175 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707178 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707180 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707182 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707185 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.714936 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707187 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707190 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707192 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707194 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707197 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707199 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707201 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707204 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707207 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707210 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707212 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.707248 2571 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707284 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707291 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707294 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707297 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.715400 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707299 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707302 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707304 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707307 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707309 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707313 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707315 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707318 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707320 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707323 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707326 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707330 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707333 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707335 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707338 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707340 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707342 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707345 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707348 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.715767 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707350 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707352 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707354 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707357 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707359 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707361 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707364 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707367 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707369 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707372 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707375 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707377 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707380 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707382 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707385 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707387 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707390 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707392 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707396 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707399 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.716217 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707401 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707403 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707406 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707408 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707411 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707413 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707415 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707417 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707420 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707422 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707424 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707427 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707429 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707431 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707433 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707436 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707438 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707440 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707443 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707446 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.716682 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707449 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707452 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707456 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707458 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707460 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707463 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707465 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707468 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707470 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707472 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707476 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707478 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707481 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707483 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707486 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707488 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707491 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707493 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707495 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707498 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.717150 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707500 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707502 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707505 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707507 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707510 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707512 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707514 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707517 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707519 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707522 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707524 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707527 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707529 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707532 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707535 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707538 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707540 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707542 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707545 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707549 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.717628 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707553 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707556 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.707560 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.714450 2571 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.714466 2571 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.715066 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.715072 2571 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715129 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715134 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715138 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715140 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715143 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715146 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715149 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715151 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715154 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715157 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715159 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715162 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.718094 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715164 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715167 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715169 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715172 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715174 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715176 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715179 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715182 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715184 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715187 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715189 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715192 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715195 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715197 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715200 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715202 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715205 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715209 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715212 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.718519 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715214 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715217 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715219 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715222 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715225 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715227 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715229 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715232 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715234 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715237 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715239 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715241 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715244 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715246 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715249 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715251 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715254 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715256 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715258 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715261 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.718975 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715263 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715265 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715268 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715270 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715273 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715276 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715278 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715280 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715283 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715285 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715288 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715291 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715294 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715298 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715302 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715306 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715309 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715311 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715314 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.719425 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715317 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715320 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715322 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715325 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715328 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715330 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715333 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715335 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715338 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715340 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715343 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715345 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715347 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715350 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715352 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715355 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715358 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715360 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715362 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.719881 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715365 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715368 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715370 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715372 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715375 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715378 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715381 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715384 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715386 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715389 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715391 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715395 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715398 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715401 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715404 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715407 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.720442 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715410 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.715438 2571 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715579 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715584 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715588 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715590 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715593 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715596 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715598 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715601 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715603 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715606 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715610 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715613 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715616 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.720802 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715618 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715621 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715623 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715625 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715628 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715630 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715633 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715635 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715638 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715641 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715643 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715645 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715648 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715650 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715652 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715654 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715657 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715659 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715661 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715664 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.721156 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715666 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715669 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715671 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715673 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715676 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715678 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715681 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715683 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715685 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715688 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715690 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715692 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715695 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715697 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715700 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715702 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715705 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715707 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715709 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715712 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.721640 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715714 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715717 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715719 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715722 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715724 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715726 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715729 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715731 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715733 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715736 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715738 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715740 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715743 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715745 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715747 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715749 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715752 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715754 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715756 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.722113 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715759 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715761 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715764 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715766 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715769 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715771 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715774 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715776 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715779 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715782 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715784 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715787 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715789 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715791 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715793 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715798 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715800 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715803 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715805 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.722541 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715808 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715810 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715812 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715815 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715817 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715819 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715822 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715824 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715827 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715829 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715832 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715834 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715838 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715841 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715844 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.722972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.715866 2571 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715898 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715901 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715904 2571 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715906 2571 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715909 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715911 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715914 2571 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715916 2571 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715919 2571 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715921 2571 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715936 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715939 2571 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715942 2571 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715945 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715947 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715950 2571 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715952 2571 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715955 2571 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715957 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:10.723309 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715960 2571 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715962 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715964 2571 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715966 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715969 2571 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715971 2571 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715974 2571 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715976 2571 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715978 2571 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715981 2571 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715983 2571 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715985 2571 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715988 2571 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715990 2571 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715992 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715995 2571 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.715997 2571 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716000 2571 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716002 2571 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:10.723766 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716004 2571 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716008 2571 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716011 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716014 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716017 2571 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716020 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716022 2571 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716024 2571 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716028 2571 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716030 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716032 2571 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716035 2571 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716037 2571 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716040 2571 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716043 2571 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716046 2571 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716049 2571 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716051 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716053 2571 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:10.724207 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716056 2571 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716058 2571 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716060 2571 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716063 2571 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716065 2571 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716067 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716070 2571 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716072 2571 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716074 2571 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716077 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716079 2571 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716082 2571 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716084 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716087 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716089 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716091 2571 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716094 2571 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716096 2571 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716098 2571 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716101 2571 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:10.724638 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716103 2571 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716105 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716108 2571 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716111 2571 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716113 2571 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716116 2571 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716118 2571 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716123 2571 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716125 2571 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716128 2571 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716130 2571 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716132 2571 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716135 2571 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716137 2571 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716141 2571 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716143 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716146 2571 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716148 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716151 2571 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716153 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:10.725238 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716156 2571 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716158 2571 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716160 2571 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716163 2571 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716165 2571 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716167 2571 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716170 2571 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716172 2571 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.716174 2571 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.716230 2571 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.718527 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.719511 2571 server.go:1014] "Starting client certificate rotation" Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.719610 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.720311 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.721669 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:10.725704 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.723186 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:10.738046 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.738029 2571 log.go:25] "Validated CRI v1 runtime API" Nov 03 19:50:10.742006 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.741991 2571 log.go:25] "Validated CRI v1 image API" Nov 03 19:50:10.742836 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.742814 2571 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 19:50:10.748844 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.748826 2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a500aa42-fdca-4169-b49c-2f67da2c7ab5:/dev/nvme0n1p3 a89ea54e-bb20-4e28-bc99-8d909afe089e:/dev/nvme0n1p4] Nov 03 19:50:10.748902 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.748843 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 03 19:50:10.755050 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.754941 2571 manager.go:217] Machine: {Timestamp:2026-11-03 19:50:10.753486967 +0000 UTC m=+0.345897315 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3202785 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec247f86d6a65fb33dad3566ea56af4a SystemUUID:ec247f86-d6a6-5fb3-3dad-3566ea56af4a BootID:6891a63d-f596-472c-9949-cbc83eb27645 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:71:6a:1a:c9:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:71:6a:1a:c9:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:5e:31:5e:1c:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 19:50:10.755050 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.755043 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 19:50:10.755187 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.755112 2571 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 19:50:10.756335 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.756312 2571 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 19:50:10.756454 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.756337 2571 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-64.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 19:50:10.756532 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.756457 2571 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 19:50:10.756532 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.756464 2571 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 19:50:10.756532 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.756497 2571 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:10.756532 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.756529 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:10.757760 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.757750 2571 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 19:50:10.761958 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.761947 2571 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 19:50:10.762065 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.762057 2571 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 19:50:10.762831 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.762822 2571 kubelet.go:493] "Attempting to sync node with API server" Nov 03 19:50:10.762860 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.762836 2571 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 19:50:10.762860 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.762845 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 19:50:10.762860 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.762853 2571 kubelet.go:405] "Adding apiserver pod source" Nov 03 19:50:10.762860 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.762860 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 19:50:10.763186 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.763174 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:10.765691 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.765672 2571 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 19:50:10.774667 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.774653 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:10.775514 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775503 2571 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 19:50:10.775565 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775531 2571 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 19:50:10.775671 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775662 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 19:50:10.775701 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775677 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 19:50:10.775701 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775683 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 19:50:10.775701 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775690 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 19:50:10.775701 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775695 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 19:50:10.775701 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.775700 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 19:50:10.776440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.776430 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 19:50:10.776475 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.776440 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 19:50:10.776475 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.776448 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 19:50:10.776475 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.776454 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 19:50:10.776475 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.776461 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 19:50:10.776475 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.776471 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 19:50:10.777866 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.777857 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 19:50:10.777866 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.777866 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 19:50:10.781648 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.781634 2571 server.go:1263] "Started kubelet" Nov 03 19:50:10.781713 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.781692 2571 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 19:50:10.781798 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.781761 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 19:50:10.781829 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.781813 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 19:50:10.782289 ip-10-0-131-64 systemd[1]: Started Kubernetes Kubelet. Nov 03 19:50:10.783466 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.783441 2571 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 19:50:10.785390 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.785375 2571 server.go:317] "Adding debug handlers to kubelet server" Nov 03 19:50:10.788360 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.788344 2571 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 03 19:50:10.790994 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.790957 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 19:50:10.791608 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.791592 2571 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 19:50:10.791691 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.791681 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:10.792268 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792252 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 19:50:10.792268 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792253 2571 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 19:50:10.792383 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792275 2571 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 19:50:10.792413 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792382 2571 reconstruct.go:97] "Volume reconstruction finished" Nov 03 19:50:10.792413 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792392 2571 reconciler.go:29] "Reconciler: start to sync state" Nov 03 19:50:10.792691 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792674 2571 factory.go:55] Registering systemd factory Nov 03 19:50:10.792729 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792697 2571 factory.go:223] Registration of the systemd container factory successfully Nov 03 19:50:10.792961 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792946 2571 factory.go:153] Registering CRI-O factory Nov 03 19:50:10.793028 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.792966 2571 factory.go:223] Registration of the crio container factory successfully Nov 03 19:50:10.793028 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.793014 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 19:50:10.793120 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.793031 2571 factory.go:103] Registering Raw factory Nov 03 19:50:10.793120 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.793044 2571 manager.go:1199] Started watching for new ooms in manager Nov 03 19:50:10.794021 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.794007 2571 manager.go:319] Starting recovery of all containers Nov 03 19:50:10.803365 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:10.803330 2571 helpers.go:246] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/pids.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/pids.max: no such device Nov 03 19:50:10.805332 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.805318 2571 manager.go:324] Recovery completed Nov 03 19:50:10.808797 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.808785 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:10.810198 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.810176 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:10.810260 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.810213 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:10.810260 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.810224 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:10.810645 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.810633 2571 cpu_manager.go:226] "Starting" policy="none" Nov 03 19:50:10.810645 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.810643 2571 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 19:50:10.810743 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.810657 2571 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 19:50:10.810743 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.810659 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:10.811357 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.811342 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:10.811430 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.811366 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:10.811430 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.811378 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:10.812796 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.812783 2571 policy_none.go:50] "Start" Nov 03 19:50:10.812847 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.812802 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 19:50:10.812847 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.812815 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 19:50:10.814918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.814907 2571 policy_none.go:44] "Start" Nov 03 19:50:10.855239 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.855212 2571 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.857444 2571 manager.go:341] "Starting Device Plugin manager" Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.857473 2571 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.857485 2571 server.go:87] "Starting device plugin registration server" Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.857693 2571 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.857703 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.857961 2571 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.858031 2571 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 19:50:10.859778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.858039 2571 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 19:50:10.880411 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.860108 2571 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 19:50:10.880411 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.860155 2571 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:10.880411 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.872691 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 19:50:10.880411 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.873920 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 19:50:10.880411 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.873955 2571 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 19:50:10.880411 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.873974 2571 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 19:50:10.880411 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.874010 2571 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 03 19:50:10.926134 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.925972 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-64.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 03 19:50:10.926134 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.926029 2571 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-64.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 03 19:50:10.927050 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:10.926001 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-64.us-west-1.compute.internal.18e4a0da3caad4c7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-64.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-64.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 19:50:10.781443271 +0000 UTC m=+0.373853618,LastTimestamp:2026-11-03 19:50:10.781443271 +0000 UTC m=+0.373853618,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-64.us-west-1.compute.internal,}" Nov 03 19:50:10.958571 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.958527 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:10.959274 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.959259 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:10.959345 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.959288 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:10.959345 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.959303 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:10.959345 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.959338 2571 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:10.974888 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.974868 2571 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal"] Nov 03 19:50:10.974975 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.974914 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:10.975655 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.975631 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:10.975728 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.975660 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:10.975728 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.975684 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:10.977936 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.977916 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:10.978074 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978059 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:10.978111 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978091 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:10.978621 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978607 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:10.978621 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978619 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:10.978692 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978634 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:10.978692 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978637 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:10.978692 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978653 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:10.978692 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.978660 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:10.981182 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.981166 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:10.981251 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.981196 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:10.981902 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.981884 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:10.982005 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.981917 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:10.982005 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.981942 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:10.993573 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.993556 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be11478d32fa8c827db5f33a49eaff7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"2be11478d32fa8c827db5f33a49eaff7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:10.993642 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.993578 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:10.993642 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:10.993594 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.008752 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.008732 2571 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 19:50:11.008840 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.008827 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lmks4" Nov 03 19:50:11.010144 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.010124 2571 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.012133 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.012118 2571 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.038066 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.038036 2571 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 03 19:50:11.038135 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.038041 2571 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 03 19:50:11.038135 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.038043 2571 reflector.go:204] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" Nov 03 19:50:11.086078 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.086055 2571 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-64.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 03 19:50:11.086165 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.086058 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-64.us-west-1.compute.internal.18e4a0da3e6198a3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-64.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-64.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-64.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 19:50:10.810198179 +0000 UTC m=+0.402608526,LastTimestamp:2026-11-03 19:50:10.810198179 +0000 UTC m=+0.402608526,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-64.us-west-1.compute.internal,}" Nov 03 19:50:11.094242 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.094222 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be11478d32fa8c827db5f33a49eaff7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"2be11478d32fa8c827db5f33a49eaff7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.094300 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.094244 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.094300 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.094258 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.094300 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.094284 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.094389 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.094302 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.094389 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.094314 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be11478d32fa8c827db5f33a49eaff7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"2be11478d32fa8c827db5f33a49eaff7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.107903 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.107886 2571 kubelet_node_status.go:115] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-131-64.us-west-1.compute.internal\" not found" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.230081 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.230024 2571 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-64.us-west-1.compute.internal\" not found" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.308074 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.308052 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:11.308941 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.308913 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:11.309052 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.308962 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:11.309052 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.308981 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:11.309052 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.309011 2571 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.315045 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.315032 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.318186 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.318172 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.366978 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.366956 2571 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:11.367071 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.366982 2571 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-64.us-west-1.compute.internal\": node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:11.480483 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.480421 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:11.581287 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.581245 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:11.681336 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.681306 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:11.719812 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:11.719794 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 03 19:50:11.720253 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.719916 2571 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://ac5c5bdcb9dd34b2db451ae290864639-b04dcf4e4c158c13.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-131-64.us-west-1.compute.internal.18e4a0da3e6198a3\": read tcp 10.0.131.64:34234->18.220.126.244:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-131-64.us-west-1.compute.internal.18e4a0da3e6198a3 default 4803 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-64.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-64.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-64.us-west-1.compute.internal,},FirstTimestamp:2026-11-03 19:50:10 +0000 UTC,LastTimestamp:2026-11-03 19:50:10.975646755 +0000 UTC m=+0.568057108,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-64.us-west-1.compute.internal,}" Nov 03 19:50:11.782339 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.782269 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:11.882600 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.882572 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:11.982837 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:11.982813 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:12.015582 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.015550 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 19:45:11 +0000 UTC" deadline="2028-07-12 22:55:48.688367406 +0000 UTC" Nov 03 19:50:12.015582 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.015577 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14811h5m36.672792485s" Nov 03 19:50:12.055098 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.055048 2571 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:12.055909 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.055896 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:12.056006 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.055939 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:12.056006 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.055953 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:12.083065 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.083037 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:12.140536 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.140515 2571 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:12.183764 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.183735 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:12.284187 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.284164 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:12.301269 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.301251 2571 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:12.384446 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.384384 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:12.427711 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:12.427685 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095256848cfdd23f0d4ac6f78af21242.slice/crio-aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2 WatchSource:0}: Error finding container aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2: Status 404 returned error can't find the container with id aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2 Nov 03 19:50:12.432822 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.432806 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 19:50:12.484822 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.484793 2571 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:12.531085 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.531065 2571 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:12.592371 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.592349 2571 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:12.658531 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.658514 2571 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:12.660025 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.660012 2571 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:12.666918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.666902 2571 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:12.728365 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.728342 2571 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:12.765293 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.765269 2571 apiserver.go:52] "Watching apiserver" Nov 03 19:50:12.792157 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.792134 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 03 19:50:12.879563 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.879519 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"2be11478d32fa8c827db5f33a49eaff7","Type":"ContainerStarted","Data":"16e9ad9d37eb87c8286262b1d3b99a4bb3e73581d80b84fbbb6ff1aab8efbe92"} Nov 03 19:50:12.879678 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.879563 2571 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 19:50:12.879919 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.879900 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-bfjzb","openshift-multus/multus-cgd84","openshift-multus/network-metrics-daemon-vzcq7","openshift-ovn-kubernetes/ovnkube-node-xgbcv","kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-vmrhq","kube-system/konnectivity-agent-25m4r","openshift-cluster-node-tuning-operator/tuned-dqb5g","openshift-network-diagnostics/network-check-target-rnq79","openshift-network-operator/iptables-alerter-gwtgg","kube-system/global-pull-secret-syncer-jllnn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w","openshift-dns/node-resolver-mmsnt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal"] Nov 03 19:50:12.883962 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.883943 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:12.886248 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.886223 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:12.888506 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.888489 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:12.888584 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.888565 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:12.890842 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.890821 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.893292 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.893273 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:12.895539 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.895524 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cgd84" Nov 03 19:50:12.898102 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.898086 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:12.898164 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.898151 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:12.900406 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.900390 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:12.900472 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:12.900439 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:12.902824 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.902804 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:12.903203 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903185 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.903315 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903220 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.903315 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903239 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-device-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.903315 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903265 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft74v\" (UniqueName: \"kubernetes.io/projected/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-kube-api-access-ft74v\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:12.903449 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903328 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.903449 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903376 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.903449 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903395 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cp6q\" (UniqueName: \"kubernetes.io/projected/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kube-api-access-7cp6q\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.903449 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903445 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3eeb01d-abf0-404d-bae0-5810acc09628-agent-certs\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:12.903584 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903475 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-iptables-alerter-script\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:12.903584 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903501 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059455b4-e54c-4e09-9115-c264a98d5d29-tmp-dir\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:12.903584 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903545 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxjb9\" (UniqueName: \"kubernetes.io/projected/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-kube-api-access-sxjb9\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:12.903584 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903570 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3eeb01d-abf0-404d-bae0-5810acc09628-konnectivity-ca\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:12.903745 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903589 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/059455b4-e54c-4e09-9115-c264a98d5d29-hosts-file\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:12.903745 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903627 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-host-slash\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:12.903745 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903678 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vprr\" (UniqueName: \"kubernetes.io/projected/059455b4-e54c-4e09-9115-c264a98d5d29-kube-api-access-5vprr\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:12.903745 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903717 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:12.903745 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.903741 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:12.905166 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.905152 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:12.910771 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.908858 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:12.913655 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.913632 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"095256848cfdd23f0d4ac6f78af21242","Type":"ContainerStarted","Data":"aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2"} Nov 03 19:50:12.913790 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.913721 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:12.942042 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.942020 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 19:50:12.942042 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.941995 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:12.942170 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.942040 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:12.942170 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.942130 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ftqzb\"" Nov 03 19:50:12.943619 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.943599 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pc2lm\"" Nov 03 19:50:12.943732 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.943633 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 19:50:12.943732 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.943662 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 19:50:12.948136 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.948120 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 19:50:12.948249 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.948164 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 19:50:12.948337 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.948324 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 19:50:12.948385 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.948353 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n4htx\"" Nov 03 19:50:12.950401 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.950387 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 19:50:12.950548 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.950531 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 19:50:12.950548 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.950547 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-62dzj\"" Nov 03 19:50:12.952758 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.952742 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 19:50:12.952845 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.952805 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 19:50:12.952976 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.952961 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 19:50:12.953055 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.953019 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 19:50:12.953095 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.953086 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-72xbf\"" Nov 03 19:50:12.960299 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.960285 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pvbsg\"" Nov 03 19:50:12.960375 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.960312 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 19:50:12.992052 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992033 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 19:50:12.992217 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992201 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4nq97\"" Nov 03 19:50:12.992294 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992238 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dqdcf\"" Nov 03 19:50:12.992294 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992266 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tfxx4\"" Nov 03 19:50:12.992591 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992576 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 19:50:12.992889 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992864 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 19:50:12.993013 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992919 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 19:50:12.993013 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992927 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 19:50:12.993013 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992956 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 19:50:12.993013 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992985 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 19:50:12.993013 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992969 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 19:50:12.993013 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992986 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:12.993244 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.993056 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 19:50:12.993244 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.993001 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:12.993244 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.992961 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 19:50:12.993244 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.993208 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 19:50:12.997188 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.997169 2571 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 03 19:50:12.997275 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:12.997219 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vqm94" Nov 03 19:50:13.004588 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004573 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-sys\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.004640 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004595 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dghrd\" (UniqueName: \"kubernetes.io/projected/55b3ebe4-88ee-440e-9eba-e67098391841-kube-api-access-dghrd\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.004640 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004610 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-host\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.004640 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004627 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059455b4-e54c-4e09-9115-c264a98d5d29-tmp-dir\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:13.004775 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004643 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.004775 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004661 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-etc-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.004775 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004721 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/059455b4-e54c-4e09-9115-c264a98d5d29-hosts-file\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:13.004916 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004780 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-socket-dir-parent\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.004916 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004816 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55b3ebe4-88ee-440e-9eba-e67098391841-serviceca\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.004916 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004816 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/059455b4-e54c-4e09-9115-c264a98d5d29-hosts-file\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:13.004916 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004866 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-netns\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.004916 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004885 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059455b4-e54c-4e09-9115-c264a98d5d29-tmp-dir\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:13.004916 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004897 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-var-lib-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004928 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.004978 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-node-log\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005007 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005036 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005061 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005088 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-device-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005102 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005122 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-etc-kubernetes\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005147 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-device-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005147 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-ovn\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005178 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005192 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-bin\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005220 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005243 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-conf-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005265 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005295 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005315 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-kubernetes\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005341 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-systemd\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005369 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-tuned\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005385 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-iptables-alerter-script\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005417 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-netns\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005489 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-multus\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005531 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-systemd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005563 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005608 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84bnz\" (UniqueName: \"kubernetes.io/projected/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-kube-api-access-84bnz\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005649 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005695 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.005737 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005737 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vprr\" (UniqueName: \"kubernetes.io/projected/059455b4-e54c-4e09-9115-c264a98d5d29-kube-api-access-5vprr\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005762 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005819 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-iptables-alerter-script\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005901 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-kubelet-config\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005944 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cni-binary-copy\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005926 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.005982 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006006 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-system-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006045 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006060 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-daemon-config\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006102 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-netd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006136 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-modprobe-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006165 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-tmp\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006187 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55b3ebe4-88ee-440e-9eba-e67098391841-host\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006210 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-cnibin\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006235 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006276 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-conf\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.006423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006314 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-run\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006363 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006399 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006448 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3eeb01d-abf0-404d-bae0-5810acc09628-agent-certs\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006465 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-env-overrides\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006490 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-lib-modules\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.006492 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006499 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006507 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft74v\" (UniqueName: \"kubernetes.io/projected/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-kube-api-access-ft74v\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006524 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cp6q\" (UniqueName: \"kubernetes.io/projected/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kube-api-access-7cp6q\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.006584 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:13.506556408 +0000 UTC m=+3.098966764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006621 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cnibin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006745 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-multus-certs\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006773 2571 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006784 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-systemd-units\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006813 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-slash\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006847 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-log-socket\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.007196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006876 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxjb9\" (UniqueName: \"kubernetes.io/projected/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-kube-api-access-sxjb9\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006895 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3eeb01d-abf0-404d-bae0-5810acc09628-konnectivity-ca\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006918 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-k8s-cni-cncf-io\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006947 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvslz\" (UniqueName: \"kubernetes.io/projected/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-kube-api-access-cvslz\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006965 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-dbus\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.006992 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007024 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007057 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007086 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-hostroot\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007116 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h92vn\" (UniqueName: \"kubernetes.io/projected/e91996ad-4da7-45d6-89af-c384db0d8211-kube-api-access-h92vn\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007155 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysconfig\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007200 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-var-lib-kubelet\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007239 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-bin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007270 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-host-slash\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007298 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-kubelet\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007329 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-kubelet\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.007746 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007349 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-config\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.008215 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007363 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-script-lib\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.008215 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007361 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-host-slash\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:13.008215 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007384 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-655qz\" (UniqueName: \"kubernetes.io/projected/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-kube-api-access-655qz\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.008215 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.007396 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3eeb01d-abf0-404d-bae0-5810acc09628-konnectivity-ca\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:13.010311 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.010295 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3eeb01d-abf0-404d-bae0-5810acc09628-agent-certs\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:13.073345 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.073315 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vprr\" (UniqueName: \"kubernetes.io/projected/059455b4-e54c-4e09-9115-c264a98d5d29-kube-api-access-5vprr\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:13.073581 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.073563 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cp6q\" (UniqueName: \"kubernetes.io/projected/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kube-api-access-7cp6q\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.073745 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.073729 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft74v\" (UniqueName: \"kubernetes.io/projected/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-kube-api-access-ft74v\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:13.073940 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.073924 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxjb9\" (UniqueName: \"kubernetes.io/projected/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-kube-api-access-sxjb9\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:13.108172 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108142 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h92vn\" (UniqueName: \"kubernetes.io/projected/e91996ad-4da7-45d6-89af-c384db0d8211-kube-api-access-h92vn\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108177 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysconfig\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108223 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-var-lib-kubelet\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108240 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-bin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108260 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-kubelet\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108275 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-kubelet\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108279 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysconfig\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108291 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-config\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108305 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-script-lib\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108320 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655qz\" (UniqueName: \"kubernetes.io/projected/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-kube-api-access-655qz\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108335 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-var-lib-kubelet\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108342 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-sys\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108356 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-kubelet\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108359 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-bin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108395 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-kubelet\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108606 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-sys\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108634 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dghrd\" (UniqueName: \"kubernetes.io/projected/55b3ebe4-88ee-440e-9eba-e67098391841-kube-api-access-dghrd\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108652 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-host\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108667 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108687 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-etc-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108713 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-socket-dir-parent\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108737 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-host\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108762 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55b3ebe4-88ee-440e-9eba-e67098391841-serviceca\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108786 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-netns\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108809 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-var-lib-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108805 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-etc-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.108972 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108844 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108868 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-node-log\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108871 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-netns\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108892 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108911 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-socket-dir-parent\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108923 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108986 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-script-lib\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108997 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-var-lib-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108927 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-etc-kubernetes\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109004 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-etc-kubernetes\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109039 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-node-log\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109080 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-ovn\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109096 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109118 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-ovn\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109121 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-bin\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109139 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-config\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109215 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-bin\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.109816 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109273 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-conf-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109312 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-conf-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109365 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109416 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109383 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55b3ebe4-88ee-440e-9eba-e67098391841-serviceca\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109435 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-kubernetes\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109469 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109471 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-systemd\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109507 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-kubernetes\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109514 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-systemd\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109512 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-tuned\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.108910 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109548 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-netns\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109582 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-multus\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109602 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-systemd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109628 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-multus\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109638 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-netns\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.110899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109649 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109678 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84bnz\" (UniqueName: \"kubernetes.io/projected/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-kube-api-access-84bnz\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109686 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-systemd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109700 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109712 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109859 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-kubelet-config\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109918 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109901 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-kubelet-config\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109862 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.109974 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cni-binary-copy\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110003 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-system-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110025 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-daemon-config\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110065 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-netd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110089 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-modprobe-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110115 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-tmp\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110153 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-netd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.111772 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110089 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-system-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110174 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-modprobe-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110150 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55b3ebe4-88ee-440e-9eba-e67098391841-host\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110220 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-cnibin\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110274 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-conf\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110298 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-run\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110340 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-env-overrides\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110367 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-lib-modules\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110394 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cnibin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110444 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-cnibin\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110464 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-conf\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110518 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-run\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110540 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cni-binary-copy\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110549 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-multus-certs\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110581 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-systemd-units\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110584 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-multus-certs\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110342 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55b3ebe4-88ee-440e-9eba-e67098391841-host\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.112440 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110606 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-slash\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110588 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-daemon-config\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110644 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-log-socket\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110675 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-k8s-cni-cncf-io\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110699 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-systemd-units\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110708 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvslz\" (UniqueName: \"kubernetes.io/projected/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-kube-api-access-cvslz\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110735 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-dbus\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110760 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-env-overrides\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110776 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-lib-modules\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110645 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-slash\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110665 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cnibin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110763 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110823 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-dbus\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110777 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-k8s-cni-cncf-io\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110739 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-log-socket\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110824 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.110826 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110861 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.112918 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110881 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.110907 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret podName:62ac74a8-8df8-48fd-8a09-9ce51991bd84 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:13.61088647 +0000 UTC m=+3.203296823 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret") pod "global-pull-secret-syncer-jllnn" (UID: "62ac74a8-8df8-48fd-8a09-9ce51991bd84") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.110944 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-hostroot\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.111034 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-hostroot\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.111043 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.111274 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.112679 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-tuned\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.112718 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-tmp\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.113431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.112758 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.173530 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.173474 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:13.173530 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.173499 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:13.173675 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.173535 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jqnxf for pod openshift-network-diagnostics/network-check-target-rnq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:13.173675 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.173601 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf podName:bb1c6275-037e-44d2-89c0-8bb80d832a11 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:13.673583467 +0000 UTC m=+3.265993841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jqnxf" (UniqueName: "kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf") pod "network-check-target-rnq79" (UID: "bb1c6275-037e-44d2-89c0-8bb80d832a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:13.175749 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.175724 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dghrd\" (UniqueName: \"kubernetes.io/projected/55b3ebe4-88ee-440e-9eba-e67098391841-kube-api-access-dghrd\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.176162 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.176137 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84bnz\" (UniqueName: \"kubernetes.io/projected/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-kube-api-access-84bnz\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.176276 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.176259 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h92vn\" (UniqueName: \"kubernetes.io/projected/e91996ad-4da7-45d6-89af-c384db0d8211-kube-api-access-h92vn\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.176318 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.176277 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-655qz\" (UniqueName: \"kubernetes.io/projected/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-kube-api-access-655qz\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.179157 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.177489 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvslz\" (UniqueName: \"kubernetes.io/projected/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-kube-api-access-cvslz\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.196151 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.196133 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:13.201523 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.201502 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:13.206290 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.206270 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616c46b6_a9fb_4a1c_b10d_b6d623f97ddd.slice/crio-feb18e0c9c2e03203b8b9fa214561d4611b043ac125325b772d3e06ec4b10a3a WatchSource:0}: Error finding container feb18e0c9c2e03203b8b9fa214561d4611b043ac125325b772d3e06ec4b10a3a: Status 404 returned error can't find the container with id feb18e0c9c2e03203b8b9fa214561d4611b043ac125325b772d3e06ec4b10a3a Nov 03 19:50:13.210679 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.210661 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059455b4_e54c_4e09_9115_c264a98d5d29.slice/crio-c19b5a70f4bbd50938fefbef24d10a27e296e653fd871f272b0822307cdac8e1 WatchSource:0}: Error finding container c19b5a70f4bbd50938fefbef24d10a27e296e653fd871f272b0822307cdac8e1: Status 404 returned error can't find the container with id c19b5a70f4bbd50938fefbef24d10a27e296e653fd871f272b0822307cdac8e1 Nov 03 19:50:13.215610 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.215586 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:13.215688 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.215629 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:13.220674 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.220657 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cgd84" Nov 03 19:50:13.226245 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.226222 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3eeb01d_abf0_404d_bae0_5810acc09628.slice/crio-fbb0d9c291a6a91756503a45a0aa23121756cdef3dc7b03637eab6c0802b593d WatchSource:0}: Error finding container fbb0d9c291a6a91756503a45a0aa23121756cdef3dc7b03637eab6c0802b593d: Status 404 returned error can't find the container with id fbb0d9c291a6a91756503a45a0aa23121756cdef3dc7b03637eab6c0802b593d Nov 03 19:50:13.230180 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.230155 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df91d19_7cca_4ca4_b47a_f1246e6c5ee5.slice/crio-4a6293173668a1a5e0db8bd60153e46f1b2e35d07d6e2a3fe49e729aefbea509 WatchSource:0}: Error finding container 4a6293173668a1a5e0db8bd60153e46f1b2e35d07d6e2a3fe49e729aefbea509: Status 404 returned error can't find the container with id 4a6293173668a1a5e0db8bd60153e46f1b2e35d07d6e2a3fe49e729aefbea509 Nov 03 19:50:13.232859 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.232843 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda57dcaf_f5c2_47ef_9ea5_6b12a0a71dbc.slice/crio-84c9e2da3d4b79e1a35876572f184c4858dfff856054349ceb48405f4d71343f WatchSource:0}: Error finding container 84c9e2da3d4b79e1a35876572f184c4858dfff856054349ceb48405f4d71343f: Status 404 returned error can't find the container with id 84c9e2da3d4b79e1a35876572f184c4858dfff856054349ceb48405f4d71343f Nov 03 19:50:13.237067 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.237051 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:13.245536 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.245514 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:13.245783 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.245766 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b3ebe4_88ee_440e_9eba_e67098391841.slice/crio-88b666cadc235856fefd4865702ef0ad0060320843f7f070a0393da1cb554900 WatchSource:0}: Error finding container 88b666cadc235856fefd4865702ef0ad0060320843f7f070a0393da1cb554900: Status 404 returned error can't find the container with id 88b666cadc235856fefd4865702ef0ad0060320843f7f070a0393da1cb554900 Nov 03 19:50:13.250411 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.250397 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:13.253131 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.253107 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76731d78_a2c0_4a6b_a4f0_f1bdfa02c7c9.slice/crio-23729ee503470037463bbefba93ba10854d44129a909a6c91b72393083a436b2 WatchSource:0}: Error finding container 23729ee503470037463bbefba93ba10854d44129a909a6c91b72393083a436b2: Status 404 returned error can't find the container with id 23729ee503470037463bbefba93ba10854d44129a909a6c91b72393083a436b2 Nov 03 19:50:13.258831 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.258811 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91996ad_4da7_45d6_89af_c384db0d8211.slice/crio-8b61f222146a31a57241a90ddeaa43349548e979cf53bd5bf19cc6c8a39b21b1 WatchSource:0}: Error finding container 8b61f222146a31a57241a90ddeaa43349548e979cf53bd5bf19cc6c8a39b21b1: Status 404 returned error can't find the container with id 8b61f222146a31a57241a90ddeaa43349548e979cf53bd5bf19cc6c8a39b21b1 Nov 03 19:50:13.262040 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.262020 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:13.270718 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:13.270698 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1687e9c0_54ea_45aa_accd_ebfcf8cc9efa.slice/crio-59be6bd5e290ec4dfa564331fa0116fd109deb2fb18aa6461017c7220030fc42 WatchSource:0}: Error finding container 59be6bd5e290ec4dfa564331fa0116fd109deb2fb18aa6461017c7220030fc42: Status 404 returned error can't find the container with id 59be6bd5e290ec4dfa564331fa0116fd109deb2fb18aa6461017c7220030fc42 Nov 03 19:50:13.515337 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.515255 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:13.515475 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.515396 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:13.515475 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.515462 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:14.515441688 +0000 UTC m=+4.107852041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:13.616618 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.616356 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:13.616618 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.616530 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:13.616618 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.616583 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret podName:62ac74a8-8df8-48fd-8a09-9ce51991bd84 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:14.616570641 +0000 UTC m=+4.208980992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret") pod "global-pull-secret-syncer-jllnn" (UID: "62ac74a8-8df8-48fd-8a09-9ce51991bd84") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:13.717293 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.717249 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:13.717479 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.717460 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:13.717479 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.717480 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:13.717601 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.717492 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jqnxf for pod openshift-network-diagnostics/network-check-target-rnq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:13.717601 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:13.717547 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf podName:bb1c6275-037e-44d2-89c0-8bb80d832a11 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:14.717528712 +0000 UTC m=+4.309939053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqnxf" (UniqueName: "kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf") pod "network-check-target-rnq79" (UID: "bb1c6275-037e-44d2-89c0-8bb80d832a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:13.884010 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.883920 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerStarted","Data":"8b61f222146a31a57241a90ddeaa43349548e979cf53bd5bf19cc6c8a39b21b1"} Nov 03 19:50:13.885401 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.885368 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bfjzb" event={"ID":"55b3ebe4-88ee-440e-9eba-e67098391841","Type":"ContainerStarted","Data":"88b666cadc235856fefd4865702ef0ad0060320843f7f070a0393da1cb554900"} Nov 03 19:50:13.886666 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.886635 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cgd84" event={"ID":"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc","Type":"ContainerStarted","Data":"84c9e2da3d4b79e1a35876572f184c4858dfff856054349ceb48405f4d71343f"} Nov 03 19:50:13.889038 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.887915 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" event={"ID":"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5","Type":"ContainerStarted","Data":"4a6293173668a1a5e0db8bd60153e46f1b2e35d07d6e2a3fe49e729aefbea509"} Nov 03 19:50:13.889144 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.889052 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mmsnt" event={"ID":"059455b4-e54c-4e09-9115-c264a98d5d29","Type":"ContainerStarted","Data":"c19b5a70f4bbd50938fefbef24d10a27e296e653fd871f272b0822307cdac8e1"} Nov 03 19:50:13.890672 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.890621 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwtgg" event={"ID":"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd","Type":"ContainerStarted","Data":"feb18e0c9c2e03203b8b9fa214561d4611b043ac125325b772d3e06ec4b10a3a"} Nov 03 19:50:13.893906 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.891938 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"59be6bd5e290ec4dfa564331fa0116fd109deb2fb18aa6461017c7220030fc42"} Nov 03 19:50:13.893906 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.893155 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" event={"ID":"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9","Type":"ContainerStarted","Data":"23729ee503470037463bbefba93ba10854d44129a909a6c91b72393083a436b2"} Nov 03 19:50:13.894741 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:13.894717 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25m4r" event={"ID":"c3eeb01d-abf0-404d-bae0-5810acc09628","Type":"ContainerStarted","Data":"fbb0d9c291a6a91756503a45a0aa23121756cdef3dc7b03637eab6c0802b593d"} Nov 03 19:50:14.000463 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.000420 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:45:13 +0000 UTC" deadline="2028-05-12 17:23:21.722539783 +0000 UTC" Nov 03 19:50:14.000463 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.000457 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13341h33m7.722088916s" Nov 03 19:50:14.524224 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.523982 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:14.524224 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.524138 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:14.524224 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.524197 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:16.52417785 +0000 UTC m=+6.116588192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:14.625038 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.625000 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:14.625328 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.625176 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:14.625328 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.625240 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret podName:62ac74a8-8df8-48fd-8a09-9ce51991bd84 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:16.625222598 +0000 UTC m=+6.217632960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret") pod "global-pull-secret-syncer-jllnn" (UID: "62ac74a8-8df8-48fd-8a09-9ce51991bd84") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:14.725731 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.725689 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:14.725913 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.725887 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:14.725913 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.725908 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:14.726063 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.725921 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jqnxf for pod openshift-network-diagnostics/network-check-target-rnq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:14.726063 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.726008 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf podName:bb1c6275-037e-44d2-89c0-8bb80d832a11 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:16.725962776 +0000 UTC m=+6.318373119 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqnxf" (UniqueName: "kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf") pod "network-check-target-rnq79" (UID: "bb1c6275-037e-44d2-89c0-8bb80d832a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:14.876218 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.876133 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:14.876218 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.876206 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:14.876218 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:14.876203 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:14.876484 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.876326 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:14.876484 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.876432 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:14.876595 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:14.876506 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:15.000665 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:15.000595 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:45:13 +0000 UTC" deadline="2028-05-25 22:47:40.908054336 +0000 UTC" Nov 03 19:50:15.000665 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:15.000664 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13658h57m25.907395279s" Nov 03 19:50:16.543403 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.543080 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:16.543940 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.543229 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:16.543940 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.543503 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:20.543480402 +0000 UTC m=+10.135890763 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:16.644221 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.644172 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:16.644484 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.644460 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:16.644545 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.644532 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret podName:62ac74a8-8df8-48fd-8a09-9ce51991bd84 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:20.644513084 +0000 UTC m=+10.236923428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret") pod "global-pull-secret-syncer-jllnn" (UID: "62ac74a8-8df8-48fd-8a09-9ce51991bd84") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:16.745456 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.745412 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:16.745620 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.745604 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:16.745740 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.745628 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:16.745740 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.745642 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jqnxf for pod openshift-network-diagnostics/network-check-target-rnq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:16.745740 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.745707 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf podName:bb1c6275-037e-44d2-89c0-8bb80d832a11 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:20.74568706 +0000 UTC m=+10.338097401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqnxf" (UniqueName: "kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf") pod "network-check-target-rnq79" (UID: "bb1c6275-037e-44d2-89c0-8bb80d832a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:16.877222 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.877189 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:16.877376 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.877328 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:16.877459 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.877389 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:16.877518 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.877457 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:16.877518 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.877504 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:16.877611 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:16.877582 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:16.919588 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.919545 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"2be11478d32fa8c827db5f33a49eaff7","Type":"ContainerStarted","Data":"0d98f1a0ce5ad923a200d686262c0f43083b9d606f63502aa277ac8a249e8c3a"} Nov 03 19:50:16.928782 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.928750 2571 generic.go:356] "Generic (PLEG): container finished" podID="095256848cfdd23f0d4ac6f78af21242" containerID="6dd8a6f875be91879594c19d11491694c5678017a3f11a568ff892b0e78b98b4" exitCode=0 Nov 03 19:50:16.928915 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:16.928803 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"095256848cfdd23f0d4ac6f78af21242","Type":"ContainerDied","Data":"6dd8a6f875be91879594c19d11491694c5678017a3f11a568ff892b0e78b98b4"} Nov 03 19:50:17.197078 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:17.196932 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" podStartSLOduration=4.196910506 podStartE2EDuration="4.196910506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:17.068594786 +0000 UTC m=+6.661005144" watchObservedRunningTime="2026-11-03 19:50:17.196910506 +0000 UTC m=+6.789320870" Nov 03 19:50:17.940361 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:17.940326 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"095256848cfdd23f0d4ac6f78af21242","Type":"ContainerStarted","Data":"35299d0da988adbefa954a4445efd4ff82cabd948be4f244de7617167571e056"} Nov 03 19:50:17.944192 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:17.944166 2571 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="69954a0c4cf903b0c0308aaea38931190e29dff5621c46c69f911d5141c41936" exitCode=0 Nov 03 19:50:17.945037 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:17.945016 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerDied","Data":"69954a0c4cf903b0c0308aaea38931190e29dff5621c46c69f911d5141c41936"} Nov 03 19:50:18.059454 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:18.059352 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" podStartSLOduration=5.059334819 podStartE2EDuration="5.059334819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:18.05889693 +0000 UTC m=+7.651307286" watchObservedRunningTime="2026-11-03 19:50:18.059334819 +0000 UTC m=+7.651745179" Nov 03 19:50:18.876742 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:18.876711 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:18.876899 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:18.876846 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:18.876993 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:18.876968 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:18.877079 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:18.877059 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:18.877132 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:18.877125 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:18.877221 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:18.877185 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:18.951820 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:18.951782 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-25m4r" event={"ID":"c3eeb01d-abf0-404d-bae0-5810acc09628","Type":"ContainerStarted","Data":"08a9163317c79791785d4284cea9755ca2630cb178f69293cfd142b8f8f194e1"} Nov 03 19:50:19.957183 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:19.956393 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bfjzb" event={"ID":"55b3ebe4-88ee-440e-9eba-e67098391841","Type":"ContainerStarted","Data":"f1d8b916f497a0f06a369318f59f727f1e2f245726be80582c1f022afeeb0351"} Nov 03 19:50:19.959465 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:19.959353 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" event={"ID":"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5","Type":"ContainerStarted","Data":"27923a68d111bc3709b4de6964343bff36af62120dd3a09b460305c9663334f5"} Nov 03 19:50:20.080465 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:20.080406 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-25m4r" podStartSLOduration=4.524537556 podStartE2EDuration="9.080388328s" totalImagesPullingTime="4.555850772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:19.068948926 +0000 UTC m=+8.661359285" watchObservedRunningTime="2026-11-03 19:50:20.080388328 +0000 UTC m=+9.672798686" Nov 03 19:50:20.600197 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:20.600160 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:20.600375 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.600322 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:20.600435 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.600386 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:28.600368882 +0000 UTC m=+18.192779236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:20.701388 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:20.701353 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:20.701536 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.701522 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:20.701764 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.701587 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret podName:62ac74a8-8df8-48fd-8a09-9ce51991bd84 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:28.701569261 +0000 UTC m=+18.293979617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret") pod "global-pull-secret-syncer-jllnn" (UID: "62ac74a8-8df8-48fd-8a09-9ce51991bd84") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:20.801683 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:20.801649 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:20.801832 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.801814 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:20.801874 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.801838 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:20.801874 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.801851 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jqnxf for pod openshift-network-diagnostics/network-check-target-rnq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:20.801970 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.801902 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf podName:bb1c6275-037e-44d2-89c0-8bb80d832a11 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:28.801884858 +0000 UTC m=+18.394295210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqnxf" (UniqueName: "kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf") pod "network-check-target-rnq79" (UID: "bb1c6275-037e-44d2-89c0-8bb80d832a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:20.877427 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:20.877058 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:20.877427 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.877194 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:20.877427 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:20.877267 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:20.877427 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.877337 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:20.877902 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:20.877786 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:20.877902 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:20.877872 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:21.525519 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:21.525493 2571 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 19:50:21.865709 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:21.865564 2571 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T19:50:21.525516251Z","UUID":"b3022c3b-d61b-4bc7-b59a-025c034ffd64","Handler":null,"Name":"","Endpoint":""} Nov 03 19:50:21.868296 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:21.867958 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 19:50:21.868296 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:21.867986 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 19:50:21.981794 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:21.981122 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cgd84" event={"ID":"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc","Type":"ContainerStarted","Data":"d45113f6a7c7dedbdd44b6c94057fe357b0f5612085cf46652642bdd0c247cc3"} Nov 03 19:50:21.987097 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:21.985371 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" event={"ID":"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5","Type":"ContainerStarted","Data":"741176ff7f5653fe57e86b2c49aa339e83b19437a309e72c896cc429369404e6"} Nov 03 19:50:22.101591 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:22.101534 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bfjzb" podStartSLOduration=4.582030216 podStartE2EDuration="10.101515902s" totalImagesPullingTime="5.519485686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:20.081273607 +0000 UTC m=+9.673683963" watchObservedRunningTime="2026-11-03 19:50:22.101515902 +0000 UTC m=+11.693926260" Nov 03 19:50:22.876089 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:22.876037 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:22.876500 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:22.876169 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:22.876500 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:22.876189 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:22.876500 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:22.876204 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:22.876500 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:22.876314 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:22.876500 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:22.876420 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:22.990716 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:22.990690 2571 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="b1f6d641efc1bd3b2a517810a0bfc23ce69537df4d74b356b398ff8911d9e045" exitCode=0 Nov 03 19:50:22.991026 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:22.990941 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerDied","Data":"b1f6d641efc1bd3b2a517810a0bfc23ce69537df4d74b356b398ff8911d9e045"} Nov 03 19:50:22.994087 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:22.993528 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mmsnt" event={"ID":"059455b4-e54c-4e09-9115-c264a98d5d29","Type":"ContainerStarted","Data":"023f8da18ca19c4ce4f94f167126cfc1b3838fb4f13bd0e25f6f0ede1bcdb3d4"} Nov 03 19:50:23.163004 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:23.162939 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-cgd84" podStartSLOduration=4.235174279 podStartE2EDuration="12.162905849s" totalImagesPullingTime="7.92773157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:22.102068615 +0000 UTC m=+11.694478971" watchObservedRunningTime="2026-11-03 19:50:23.162905849 +0000 UTC m=+12.755316206" Nov 03 19:50:23.284712 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:23.284658 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-mmsnt" podStartSLOduration=3.625888207 podStartE2EDuration="12.284640567s" totalImagesPullingTime="8.65875236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:23.283992967 +0000 UTC m=+12.876403325" watchObservedRunningTime="2026-11-03 19:50:23.284640567 +0000 UTC m=+12.877050926" Nov 03 19:50:23.552669 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:23.552589 2571 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:23.553223 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:23.553201 2571 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:23.997819 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:23.997506 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" event={"ID":"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5","Type":"ContainerStarted","Data":"3770a487d7fdddd0dcc03ee49663586aaecfc8d42b5041d954242db0d1ed5162"} Nov 03 19:50:24.002996 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.002960 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-gwtgg" event={"ID":"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd","Type":"ContainerStarted","Data":"096fd986249d87fbc33e95d446e12e4c4d9ba4d9df1ae1f47a22d4d9ae3ea295"} Nov 03 19:50:24.004423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.004395 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" event={"ID":"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9","Type":"ContainerStarted","Data":"06ca264a6fda67877f376edc80148a1dd20c2744186e6d6ef5614b5580144e57"} Nov 03 19:50:24.124344 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.124248 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" podStartSLOduration=3.879480964 podStartE2EDuration="13.12423124s" totalImagesPullingTime="9.244750276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:24.123754635 +0000 UTC m=+13.716164991" watchObservedRunningTime="2026-11-03 19:50:24.12423124 +0000 UTC m=+13.716641598" Nov 03 19:50:24.367152 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.367097 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" podStartSLOduration=1.7491999489999999 podStartE2EDuration="12.367082423s" totalImagesPullingTime="10.617882474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:24.365393862 +0000 UTC m=+13.957804219" watchObservedRunningTime="2026-11-03 19:50:24.367082423 +0000 UTC m=+13.959492804" Nov 03 19:50:24.367292 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.367250 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-gwtgg" podStartSLOduration=4.814756456 podStartE2EDuration="13.367245203s" totalImagesPullingTime="8.552488747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:24.243501881 +0000 UTC m=+13.835912247" watchObservedRunningTime="2026-11-03 19:50:24.367245203 +0000 UTC m=+13.959655558" Nov 03 19:50:24.874981 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.874946 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:24.874981 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.874976 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:24.875184 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:24.874946 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:24.875184 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:24.875102 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:24.875302 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:24.875207 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:24.875302 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:24.875288 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:25.008697 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:25.008666 2571 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="62a19ba1919885bafedd3e766a80ae9b67bce13a59e8b37509d50adc292789a2" exitCode=0 Nov 03 19:50:25.009294 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:25.008778 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerDied","Data":"62a19ba1919885bafedd3e766a80ae9b67bce13a59e8b37509d50adc292789a2"} Nov 03 19:50:26.874810 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:26.874692 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:26.874810 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:26.874693 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:26.881190 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:26.880105 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:26.881190 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:26.880115 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:26.881190 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:26.880260 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:26.881190 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:26.880358 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:27.015357 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:27.015320 2571 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="3fea4a4f30a9814311ec370b1e28ccc8ad02bc8407af64ec76074e2a8f770bea" exitCode=0 Nov 03 19:50:27.015520 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:27.015369 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerDied","Data":"3fea4a4f30a9814311ec370b1e28ccc8ad02bc8407af64ec76074e2a8f770bea"} Nov 03 19:50:28.020063 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.019865 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:28.020489 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.020466 2571 generic.go:356] "Generic (PLEG): container finished" podID="1687e9c0-54ea-45aa-accd-ebfcf8cc9efa" containerID="46ad0d4c66927dfa721d209fb58f88967da952d7267e7d8c0b14b63d689b6ce8" exitCode=1 Nov 03 19:50:28.020546 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.020531 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"dc856642cdaac54da8b6466effaa4527405001b8eef90fec31915574abd202ef"} Nov 03 19:50:28.020607 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.020596 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerDied","Data":"46ad0d4c66927dfa721d209fb58f88967da952d7267e7d8c0b14b63d689b6ce8"} Nov 03 19:50:28.020645 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.020630 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"6037487e09be7210e2790754723f45d1e704637025b4bf2b08ba9627bc47bf4c"} Nov 03 19:50:28.661587 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.661560 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:28.661773 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.661703 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:28.661773 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.661760 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.661743139 +0000 UTC m=+34.254153488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 03 19:50:28.762528 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.762501 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:28.762675 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.762619 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:28.762675 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.762675 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret podName:62ac74a8-8df8-48fd-8a09-9ce51991bd84 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.762658575 +0000 UTC m=+34.355068913 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret") pod "global-pull-secret-syncer-jllnn" (UID: "62ac74a8-8df8-48fd-8a09-9ce51991bd84") : object "kube-system"/"original-pull-secret" not registered Nov 03 19:50:28.863974 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.863776 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:28.864132 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.863950 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 03 19:50:28.864132 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.864017 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 03 19:50:28.864132 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.864034 2571 projected.go:196] Error preparing data for projected volume kube-api-access-jqnxf for pod openshift-network-diagnostics/network-check-target-rnq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:28.864132 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.864092 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf podName:bb1c6275-037e-44d2-89c0-8bb80d832a11 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.864079381 +0000 UTC m=+34.456489716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqnxf" (UniqueName: "kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf") pod "network-check-target-rnq79" (UID: "bb1c6275-037e-44d2-89c0-8bb80d832a11") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 03 19:50:28.875050 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.875023 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:28.875179 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.875066 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:28.875179 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:28.875077 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:28.875179 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.875153 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:28.875274 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.875230 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:28.875303 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:28.875283 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:29.025988 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:29.025958 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:29.026426 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:29.026342 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"14986e9e29e621b4bfcf245c0f1c31806462af727cf406d7aad1710302b9b790"} Nov 03 19:50:29.026426 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:29.026422 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"afabb48b5944e0b5621b42bafe404a71be630e7962336bb4352a1702d917bc33"} Nov 03 19:50:29.026501 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:29.026473 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"7305debf157bef907a40c60233ec7fd6f0808cf488c53cd9ef5d5c26a0ef86c2"} Nov 03 19:50:29.029094 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:29.029074 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerStarted","Data":"2582867b261c6c4789645a3ffd4dd357a05c3642c2391819dbaa0884e53e92f3"} Nov 03 19:50:30.034081 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:30.034045 2571 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="2582867b261c6c4789645a3ffd4dd357a05c3642c2391819dbaa0884e53e92f3" exitCode=0 Nov 03 19:50:30.034556 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:30.034103 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerDied","Data":"2582867b261c6c4789645a3ffd4dd357a05c3642c2391819dbaa0884e53e92f3"} Nov 03 19:50:30.876686 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:30.876653 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:30.876856 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:30.876724 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:30.876856 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:30.876746 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:30.876856 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:30.876842 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:30.877048 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:30.876885 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:30.877048 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:30.876952 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:31.039247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:31.039215 2571 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="0979a6229307417240b092fba10858b7fe60ff1646eb3c99dbb06516ab861310" exitCode=0 Nov 03 19:50:31.039812 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:31.039295 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerDied","Data":"0979a6229307417240b092fba10858b7fe60ff1646eb3c99dbb06516ab861310"} Nov 03 19:50:31.042301 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:31.042212 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:31.042524 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:31.042506 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"5a942d9aa624d4a1b5f4ed9f59b2a571cbf489cbaef5b884373b3f7ff2487caf"} Nov 03 19:50:32.047336 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:32.047303 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" event={"ID":"e91996ad-4da7-45d6-89af-c384db0d8211","Type":"ContainerStarted","Data":"eadd07ca3405b6700364805e55a6dd216399e44a17a61b580e9ff0bb0260fe82"} Nov 03 19:50:32.273956 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:32.273895 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vmrhq" podStartSLOduration=7.794962928 podStartE2EDuration="20.273882124s" totalImagesPullingTime="12.478919196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:32.27345103 +0000 UTC m=+21.865861386" watchObservedRunningTime="2026-11-03 19:50:32.273882124 +0000 UTC m=+21.866292480" Nov 03 19:50:32.877755 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:32.877722 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:32.877892 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:32.877792 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:32.877892 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:32.877879 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:32.878000 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:32.877885 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:32.878000 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:32.877979 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:32.878075 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:32.878060 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:33.052853 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:33.052826 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:33.053422 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:33.053176 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"6be85997569e580450cb7f0867110016aef4904ef4735d540f683cfc5a3d2e1b"} Nov 03 19:50:33.053744 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:33.053731 2571 scope.go:122] "RemoveContainer" containerID="46ad0d4c66927dfa721d209fb58f88967da952d7267e7d8c0b14b63d689b6ce8" Nov 03 19:50:34.059287 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.059124 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:34.059740 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.059588 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" event={"ID":"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa","Type":"ContainerStarted","Data":"e8b6b6df0dc82b0f35bcc30da1822a368233715aa09bc3d067129a2d571fa833"} Nov 03 19:50:34.059943 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.059901 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:34.060125 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.060102 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:34.060183 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.060169 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:34.075258 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.075236 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:34.075360 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.075325 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:34.343050 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.342963 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" podStartSLOduration=7.885799584 podStartE2EDuration="22.342949277s" totalImagesPullingTime="14.457149693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 19:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:34.342565812 +0000 UTC m=+23.934976169" watchObservedRunningTime="2026-11-03 19:50:34.342949277 +0000 UTC m=+23.935359631" Nov 03 19:50:34.874775 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.874746 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:34.874960 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.874808 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:34.874960 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:34.874818 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:34.875078 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:34.874955 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:34.875078 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:34.875003 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:34.875172 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:34.875096 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:35.014111 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:35.014084 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jllnn"] Nov 03 19:50:35.017248 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:35.017222 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rnq79"] Nov 03 19:50:35.017781 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:35.017760 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzcq7"] Nov 03 19:50:35.061347 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:35.061322 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:35.061721 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:35.061323 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:35.061721 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:35.061329 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:35.061721 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:35.061427 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:35.061807 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:35.061765 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:35.061847 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:35.061833 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:36.874821 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:36.874783 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:36.874821 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:36.874813 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:36.875271 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:36.874816 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:36.875271 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:36.874883 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:36.875271 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:36.875008 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:36.875271 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:36.875081 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:38.874612 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:38.874584 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:38.875117 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:38.874623 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:38.875117 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:38.874587 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:38.875117 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:38.874723 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vzcq7" podUID="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" Nov 03 19:50:38.875117 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:38.874824 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jllnn" podUID="62ac74a8-8df8-48fd-8a09-9ce51991bd84" Nov 03 19:50:38.875117 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:38.874885 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rnq79" podUID="bb1c6275-037e-44d2-89c0-8bb80d832a11" Nov 03 19:50:38.886937 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:38.886904 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:38.887134 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:38.887008 2571 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 19:50:38.887702 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:38.887682 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:40.199607 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.199581 2571 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeReady" Nov 03 19:50:40.199965 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.199701 2571 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 19:50:40.315834 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.315806 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bf2vl"] Nov 03 19:50:40.319275 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.319260 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sk2cf"] Nov 03 19:50:40.319394 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.319378 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" Nov 03 19:50:40.322505 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.322484 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-5tccb"] Nov 03 19:50:40.322618 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.322602 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" Nov 03 19:50:40.327565 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.327108 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-jv7xp"] Nov 03 19:50:40.327565 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.327176 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.330493 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.330474 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" Nov 03 19:50:40.366964 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.366947 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85d7978dc5-vflbf"] Nov 03 19:50:40.369891 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.369878 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-7bmz4"] Nov 03 19:50:40.369999 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.369984 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.372836 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.372818 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2"] Nov 03 19:50:40.372971 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.372958 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.375861 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.375843 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g"] Nov 03 19:50:40.375959 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.375946 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.379019 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.379002 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-24f98"] Nov 03 19:50:40.379599 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.379583 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.382051 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.382034 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7467cc6f4d-k57z9"] Nov 03 19:50:40.382151 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.382137 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.384974 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.384946 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-wnz6t"] Nov 03 19:50:40.385084 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.385016 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.387973 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.387915 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:40.417753 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.417730 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.417877 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.417816 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.418040 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.418022 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65fbcd98c7-5nj47"] Nov 03 19:50:40.418127 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.418071 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 03 19:50:40.419628 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.419609 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 03 19:50:40.421288 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.421270 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4"] Nov 03 19:50:40.421389 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.421374 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.424939 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.424161 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 03 19:50:40.430325 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.428565 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6"] Nov 03 19:50:40.430325 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.429511 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.434352 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.434334 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz"] Nov 03 19:50:40.434468 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.434452 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" Nov 03 19:50:40.438442 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.438423 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9924w"] Nov 03 19:50:40.439330 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.439311 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" Nov 03 19:50:40.442206 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.442189 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hsxlr"] Nov 03 19:50:40.442308 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.442293 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.445136 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445094 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bf2vl"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445149 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sk2cf"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445175 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-jv7xp"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445196 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-5tccb"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445218 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445244 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445264 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445264 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445283 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-wnz6t"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445303 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fbcd98c7-5nj47"] Nov 03 19:50:40.445327 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445320 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9924w"] Nov 03 19:50:40.445789 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.445443 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6"] Nov 03 19:50:40.450055 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450008 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzxd6\" (UniqueName: \"kubernetes.io/projected/811da5af-e26c-482c-99c3-14202b7d524e-kube-api-access-hzxd6\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.450055 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450037 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-stats-auth\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.450055 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450053 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvcwn\" (UniqueName: \"kubernetes.io/projected/6b517d3a-c283-4a81-a5ee-bd217d966bce-kube-api-access-hvcwn\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.450247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450192 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c76f66cb-43f9-4ce9-8ce4-04f241205199-serving-cert\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.450247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450220 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-service-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.450343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450281 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lvw\" (UniqueName: \"kubernetes.io/projected/616120e6-f7d2-4ca3-985d-80c1e53bc3b7-kube-api-access-44lvw\") pod \"kas-connection-checker-685895c7c9-jv7xp\" (UID: \"616120e6-f7d2-4ca3-985d-80c1e53bc3b7\") " pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" Nov 03 19:50:40.450343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450309 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-trusted-ca\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.450343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450325 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.450343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450340 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvj6d\" (UniqueName: \"kubernetes.io/projected/618261dd-822b-486a-8cd0-40b16e371320-kube-api-access-gvj6d\") pod \"kas-connection-checker-685895c7c9-bf2vl\" (UID: \"618261dd-822b-486a-8cd0-40b16e371320\") " pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" Nov 03 19:50:40.450530 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450354 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.450530 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450435 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-snapshots\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.450530 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450464 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbngk\" (UniqueName: \"kubernetes.io/projected/9300cd63-4b10-4876-96a3-7130ff5d35c7-kube-api-access-rbngk\") pod \"kas-connection-checker-685895c7c9-sk2cf\" (UID: \"9300cd63-4b10-4876-96a3-7130ff5d35c7\") " pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" Nov 03 19:50:40.450530 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450480 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/811da5af-e26c-482c-99c3-14202b7d524e-serving-cert\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.450530 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450501 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.450773 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450549 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-tmp\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.450773 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450581 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-config\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.450773 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450596 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j57c\" (UniqueName: \"kubernetes.io/projected/c76f66cb-43f9-4ce9-8ce4-04f241205199-kube-api-access-7j57c\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.450773 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.450612 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-default-certificate\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.469751 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.469726 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-24f98"] Nov 03 19:50:40.470337 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.470319 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsxlr"] Nov 03 19:50:40.470831 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.470815 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-7bmz4"] Nov 03 19:50:40.471371 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.471356 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d7978dc5-vflbf"] Nov 03 19:50:40.471915 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.471899 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7467cc6f4d-k57z9"] Nov 03 19:50:40.475590 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.475570 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz"] Nov 03 19:50:40.479283 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479261 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.479453 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479348 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.479453 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479361 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.479453 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479375 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.479742 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479726 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 03 19:50:40.479815 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479780 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.479815 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479786 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.479815 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479786 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 03 19:50:40.479815 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479786 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.479815 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479810 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.480018 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479819 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 03 19:50:40.480018 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.479861 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.480160 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.480146 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.480193 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.480149 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.480315 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.480304 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.480631 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.480619 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 03 19:50:40.480694 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.480653 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 03 19:50:40.480804 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.480791 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 03 19:50:40.530899 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.530881 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 03 19:50:40.532817 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.532802 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 03 19:50:40.551088 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551067 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ef723529-7fa2-42f5-bee1-cd5a24780a78-nginx-conf\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:40.551170 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551094 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.551170 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551128 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbngk\" (UniqueName: \"kubernetes.io/projected/9300cd63-4b10-4876-96a3-7130ff5d35c7-kube-api-access-rbngk\") pod \"kas-connection-checker-685895c7c9-sk2cf\" (UID: \"9300cd63-4b10-4876-96a3-7130ff5d35c7\") " pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" Nov 03 19:50:40.551170 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551153 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/811da5af-e26c-482c-99c3-14202b7d524e-serving-cert\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.551293 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551203 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0541c396-e42d-45e3-abe6-70b647e84341-serving-cert\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.551343 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551326 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0541c396-e42d-45e3-abe6-70b647e84341-config\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.551392 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551376 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.551435 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551426 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.551577 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551550 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq9xh\" (UniqueName: \"kubernetes.io/projected/8960915e-29b4-4a08-a517-c0ca433f4c95-kube-api-access-qq9xh\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.551622 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551606 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvcwn\" (UniqueName: \"kubernetes.io/projected/6b517d3a-c283-4a81-a5ee-bd217d966bce-kube-api-access-hvcwn\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.551657 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551642 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.551702 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551668 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13c24d6-6885-4eb9-952c-1c366b8d775b-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.551702 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551686 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.551800 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551750 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.551800 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551790 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13c24d6-6885-4eb9-952c-1c366b8d775b-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.551896 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551862 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46n9z\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.551965 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551893 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.551965 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551941 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c76f66cb-43f9-4ce9-8ce4-04f241205199-serving-cert\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.552112 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.551980 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-service-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.552112 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552068 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.552112 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552106 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-trusted-ca\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.552247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552128 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.552247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552152 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.552247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552177 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9gnm\" (UniqueName: \"kubernetes.io/projected/d13c24d6-6885-4eb9-952c-1c366b8d775b-kube-api-access-r9gnm\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.552247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552201 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.552247 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552233 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvj6d\" (UniqueName: \"kubernetes.io/projected/618261dd-822b-486a-8cd0-40b16e371320-kube-api-access-gvj6d\") pod \"kas-connection-checker-685895c7c9-bf2vl\" (UID: \"618261dd-822b-486a-8cd0-40b16e371320\") " pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" Nov 03 19:50:40.552488 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552311 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.552488 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552405 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-snapshots\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.552488 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552449 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.552488 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552480 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8960915e-29b4-4a08-a517-c0ca433f4c95-config-volume\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.552650 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552505 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k45w4\" (UniqueName: \"kubernetes.io/projected/ff8d2adc-7480-498a-8038-686b9efa537a-kube-api-access-k45w4\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.552650 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552516 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-service-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.552650 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552530 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.552650 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552559 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.552650 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552593 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.552650 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552636 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-config\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.552945 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552666 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j57c\" (UniqueName: \"kubernetes.io/projected/c76f66cb-43f9-4ce9-8ce4-04f241205199-kube-api-access-7j57c\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.552945 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552697 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzbw4\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.552945 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552912 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-default-certificate\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.553092 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.552984 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlvx8\" (UniqueName: \"kubernetes.io/projected/4e4667ad-2be3-4e3c-850b-fef51ceb0513-kube-api-access-rlvx8\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.553092 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553005 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-trusted-ca\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.553092 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553027 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-snapshots\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.553092 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553041 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fp84f\" (UniqueName: \"kubernetes.io/projected/0541c396-e42d-45e3-abe6-70b647e84341-kube-api-access-fp84f\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.553092 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553068 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8d2adc-7480-498a-8038-686b9efa537a-cert\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.553325 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553129 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzxd6\" (UniqueName: \"kubernetes.io/projected/811da5af-e26c-482c-99c3-14202b7d524e-kube-api-access-hzxd6\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.553325 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553155 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-stats-auth\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.553325 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553196 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkk8q\" (UniqueName: \"kubernetes.io/projected/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-kube-api-access-rkk8q\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.553325 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553233 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-config\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.553527 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553326 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-tmp\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.553527 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553348 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.553527 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lvw\" (UniqueName: \"kubernetes.io/projected/616120e6-f7d2-4ca3-985d-80c1e53bc3b7-kube-api-access-44lvw\") pod \"kas-connection-checker-685895c7c9-jv7xp\" (UID: \"616120e6-f7d2-4ca3-985d-80c1e53bc3b7\") " pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" Nov 03 19:50:40.553527 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553395 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frwrj\" (UniqueName: \"kubernetes.io/projected/98ee3610-e8cb-420a-a400-60cadd3d0d8c-kube-api-access-frwrj\") pod \"volume-data-source-validator-58c9f5f46d-4k9r6\" (UID: \"98ee3610-e8cb-420a-a400-60cadd3d0d8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" Nov 03 19:50:40.553527 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553322 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.553527 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553461 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.553786 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553541 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.553786 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553565 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-tmp\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.553786 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553584 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8960915e-29b4-4a08-a517-c0ca433f4c95-tmp-dir\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.553786 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553612 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:40.553786 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553638 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.553786 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553663 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.553786 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553705 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.554022 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.553802 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.053789808 +0000 UTC m=+30.646200178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : configmap references non-existent config key: service-ca.crt Nov 03 19:50:40.554022 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.553842 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k676g\" (UniqueName: \"kubernetes.io/projected/1bd2844b-9872-446c-a13f-e44cf3b448f1-kube-api-access-k676g\") pod \"network-check-source-6f78d59f99-shrbz\" (UID: \"1bd2844b-9872-446c-a13f-e44cf3b448f1\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" Nov 03 19:50:40.555621 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.555513 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/811da5af-e26c-482c-99c3-14202b7d524e-serving-cert\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.555727 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.555708 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-stats-auth\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.570951 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.570900 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.571509 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.571535 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.571563 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.571716 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.571804 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.571892 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.571903 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572105 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572235 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572278 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572401 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 19:50:40.572589 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572501 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-dtr2r\"" Nov 03 19:50:40.573155 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572648 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 03 19:50:40.573155 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572784 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 03 19:50:40.573155 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.572983 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fsnsn\"" Nov 03 19:50:40.573155 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.573147 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b5t9k\"" Nov 03 19:50:40.574857 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.574014 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:40.574857 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.574086 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.074068604 +0000 UTC m=+30.666478945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:40.575785 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.575758 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-default-certificate\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.575858 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.575764 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c76f66cb-43f9-4ce9-8ce4-04f241205199-serving-cert\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.579871 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.579895 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.579910 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.579896 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.579969 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.580002 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.580001 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.580003 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.580083 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.580053 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.580382 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.580101 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 19:50:40.613569 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.613544 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbngk\" (UniqueName: \"kubernetes.io/projected/9300cd63-4b10-4876-96a3-7130ff5d35c7-kube-api-access-rbngk\") pod \"kas-connection-checker-685895c7c9-sk2cf\" (UID: \"9300cd63-4b10-4876-96a3-7130ff5d35c7\") " pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" Nov 03 19:50:40.613633 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.613617 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvcwn\" (UniqueName: \"kubernetes.io/projected/6b517d3a-c283-4a81-a5ee-bd217d966bce-kube-api-access-hvcwn\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:40.616797 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.616774 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzxd6\" (UniqueName: \"kubernetes.io/projected/811da5af-e26c-482c-99c3-14202b7d524e-kube-api-access-hzxd6\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.616873 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.616831 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j57c\" (UniqueName: \"kubernetes.io/projected/c76f66cb-43f9-4ce9-8ce4-04f241205199-kube-api-access-7j57c\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.617210 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.617190 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvj6d\" (UniqueName: \"kubernetes.io/projected/618261dd-822b-486a-8cd0-40b16e371320-kube-api-access-gvj6d\") pod \"kas-connection-checker-685895c7c9-bf2vl\" (UID: \"618261dd-822b-486a-8cd0-40b16e371320\") " pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" Nov 03 19:50:40.617307 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.617288 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lvw\" (UniqueName: \"kubernetes.io/projected/616120e6-f7d2-4ca3-985d-80c1e53bc3b7-kube-api-access-44lvw\") pod \"kas-connection-checker-685895c7c9-jv7xp\" (UID: \"616120e6-f7d2-4ca3-985d-80c1e53bc3b7\") " pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" Nov 03 19:50:40.635076 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.635060 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" Nov 03 19:50:40.640070 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.640057 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" Nov 03 19:50:40.645699 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.645681 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:40.650488 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.650466 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" Nov 03 19:50:40.654365 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654346 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.654450 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654372 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8960915e-29b4-4a08-a517-c0ca433f4c95-config-volume\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.654450 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654391 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k45w4\" (UniqueName: \"kubernetes.io/projected/ff8d2adc-7480-498a-8038-686b9efa537a-kube-api-access-k45w4\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.654450 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654409 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.654450 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654429 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.654450 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654444 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654460 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzbw4\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654478 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvx8\" (UniqueName: \"kubernetes.io/projected/4e4667ad-2be3-4e3c-850b-fef51ceb0513-kube-api-access-rlvx8\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654498 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp84f\" (UniqueName: \"kubernetes.io/projected/0541c396-e42d-45e3-abe6-70b647e84341-kube-api-access-fp84f\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654512 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8d2adc-7480-498a-8038-686b9efa537a-cert\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654543 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkk8q\" (UniqueName: \"kubernetes.io/projected/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-kube-api-access-rkk8q\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654563 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654592 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frwrj\" (UniqueName: \"kubernetes.io/projected/98ee3610-e8cb-420a-a400-60cadd3d0d8c-kube-api-access-frwrj\") pod \"volume-data-source-validator-58c9f5f46d-4k9r6\" (UID: \"98ee3610-e8cb-420a-a400-60cadd3d0d8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654609 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654628 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8960915e-29b4-4a08-a517-c0ca433f4c95-tmp-dir\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654647 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654670 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654683 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.654710 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654697 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k676g\" (UniqueName: \"kubernetes.io/projected/1bd2844b-9872-446c-a13f-e44cf3b448f1-kube-api-access-k676g\") pod \"network-check-source-6f78d59f99-shrbz\" (UID: \"1bd2844b-9872-446c-a13f-e44cf3b448f1\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654719 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ef723529-7fa2-42f5-bee1-cd5a24780a78-nginx-conf\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654739 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654763 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0541c396-e42d-45e3-abe6-70b647e84341-serving-cert\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654776 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0541c396-e42d-45e3-abe6-70b647e84341-config\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654793 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654811 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654828 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9xh\" (UniqueName: \"kubernetes.io/projected/8960915e-29b4-4a08-a517-c0ca433f4c95-kube-api-access-qq9xh\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654845 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654861 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13c24d6-6885-4eb9-952c-1c366b8d775b-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654881 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654915 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13c24d6-6885-4eb9-952c-1c366b8d775b-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654951 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46n9z\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654969 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.655313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.654987 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.656018 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.655004 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.656018 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.655024 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.656018 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.655041 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9gnm\" (UniqueName: \"kubernetes.io/projected/d13c24d6-6885-4eb9-952c-1c366b8d775b-kube-api-access-r9gnm\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.656018 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.655057 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.656018 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.655775 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.656264 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.656099 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.656446 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.656427 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8960915e-29b4-4a08-a517-c0ca433f4c95-config-volume\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.657832 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.658216 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.658229 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.658273 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.158257869 +0000 UTC m=+30.750668218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.658762 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.659381 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.659677 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.659736 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls podName:4e4667ad-2be3-4e3c-850b-fef51ceb0513 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.15972032 +0000 UTC m=+30.752130670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-lcv5g" (UID: "4e4667ad-2be3-4e3c-850b-fef51ceb0513") : secret "samples-operator-tls" not found Nov 03 19:50:40.659849 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.659794 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0541c396-e42d-45e3-abe6-70b647e84341-config\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.660392 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.660184 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.660661 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.660433 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8960915e-29b4-4a08-a517-c0ca433f4c95-tmp-dir\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.660714 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.660680 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:40.660775 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.660724 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.160709756 +0000 UTC m=+30.753120105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:40.661735 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.661021 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:40.661735 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.661040 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:40.661735 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.661091 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.161077536 +0000 UTC m=+30.753487876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:40.661735 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.661278 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:40.661735 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.661328 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.161308024 +0000 UTC m=+30.753718375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:40.662115 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.662091 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13c24d6-6885-4eb9-952c-1c366b8d775b-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.662184 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.662137 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.662662 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.662579 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.663957 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.663099 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:40.663957 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:40.663173 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:41.163156291 +0000 UTC m=+30.755566626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:40.664670 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.664580 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ef723529-7fa2-42f5-bee1-cd5a24780a78-nginx-conf\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:40.664880 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.664855 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13c24d6-6885-4eb9-952c-1c366b8d775b-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.669884 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.669837 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.670445 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.670396 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0541c396-e42d-45e3-abe6-70b647e84341-serving-cert\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.670622 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.670551 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8d2adc-7480-498a-8038-686b9efa537a-cert\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.670940 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.670904 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.671954 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.671883 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.672730 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.672690 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.689374 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.689126 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:40.721861 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.721828 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k45w4\" (UniqueName: \"kubernetes.io/projected/ff8d2adc-7480-498a-8038-686b9efa537a-kube-api-access-k45w4\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.725352 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.725215 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frwrj\" (UniqueName: \"kubernetes.io/projected/98ee3610-e8cb-420a-a400-60cadd3d0d8c-kube-api-access-frwrj\") pod \"volume-data-source-validator-58c9f5f46d-4k9r6\" (UID: \"98ee3610-e8cb-420a-a400-60cadd3d0d8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" Nov 03 19:50:40.728518 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.728496 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzbw4\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.728657 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.728634 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k676g\" (UniqueName: \"kubernetes.io/projected/1bd2844b-9872-446c-a13f-e44cf3b448f1-kube-api-access-k676g\") pod \"network-check-source-6f78d59f99-shrbz\" (UID: \"1bd2844b-9872-446c-a13f-e44cf3b448f1\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" Nov 03 19:50:40.728711 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.728693 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkk8q\" (UniqueName: \"kubernetes.io/projected/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-kube-api-access-rkk8q\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:40.729152 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.729111 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.730360 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.729784 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9xh\" (UniqueName: \"kubernetes.io/projected/8960915e-29b4-4a08-a517-c0ca433f4c95-kube-api-access-qq9xh\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:40.730360 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.730319 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvx8\" (UniqueName: \"kubernetes.io/projected/4e4667ad-2be3-4e3c-850b-fef51ceb0513-kube-api-access-rlvx8\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:40.730724 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.730483 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp84f\" (UniqueName: \"kubernetes.io/projected/0541c396-e42d-45e3-abe6-70b647e84341-kube-api-access-fp84f\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.731314 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.731274 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:40.732289 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.731734 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9gnm\" (UniqueName: \"kubernetes.io/projected/d13c24d6-6885-4eb9-952c-1c366b8d775b-kube-api-access-r9gnm\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:40.732289 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.732258 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46n9z\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:40.745422 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.745191 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:40.756316 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.755541 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" Nov 03 19:50:40.761869 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.761803 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" Nov 03 19:50:40.769888 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.769869 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:40.874340 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.874320 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:40.874825 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.874811 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:40.875361 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.875348 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:40.928910 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.928884 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 19:50:40.929055 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.929002 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d855x\"" Nov 03 19:50:40.929106 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.929059 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-926lf\"" Nov 03 19:50:40.929106 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.929087 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 19:50:40.929180 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.929105 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9gdsm\"" Nov 03 19:50:40.996029 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:40.995980 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:41.032150 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.032119 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-jv7xp"] Nov 03 19:50:41.034955 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.034761 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-bf2vl"] Nov 03 19:50:41.035301 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:41.035277 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod616120e6_f7d2_4ca3_985d_80c1e53bc3b7.slice/crio-18faba9eee1b3994d28df1199f2318d3a3527836239b8143e87310c6ef7005bb WatchSource:0}: Error finding container 18faba9eee1b3994d28df1199f2318d3a3527836239b8143e87310c6ef7005bb: Status 404 returned error can't find the container with id 18faba9eee1b3994d28df1199f2318d3a3527836239b8143e87310c6ef7005bb Nov 03 19:50:41.035825 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.035772 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-5tccb"] Nov 03 19:50:41.059857 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.059676 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:41.060031 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.059863 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.059847362 +0000 UTC m=+31.652257701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : configmap references non-existent config key: service-ca.crt Nov 03 19:50:41.076570 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.076397 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5tccb" event={"ID":"811da5af-e26c-482c-99c3-14202b7d524e","Type":"ContainerStarted","Data":"7e050394679b107b8c16de7403d2753ea8a2c794838721fa7c176aaf4cce6f2e"} Nov 03 19:50:41.089404 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.088762 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-sk2cf"] Nov 03 19:50:41.089598 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.089548 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" event={"ID":"616120e6-f7d2-4ca3-985d-80c1e53bc3b7","Type":"ContainerStarted","Data":"18faba9eee1b3994d28df1199f2318d3a3527836239b8143e87310c6ef7005bb"} Nov 03 19:50:41.090714 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.090662 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" event={"ID":"618261dd-822b-486a-8cd0-40b16e371320","Type":"ContainerStarted","Data":"e845441bf282086133065702139b7a867fb357149fdc26366f38e53f35fbd60e"} Nov 03 19:50:41.102380 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.102353 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-7bmz4"] Nov 03 19:50:41.106851 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:41.106825 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc76f66cb_43f9_4ce9_8ce4_04f241205199.slice/crio-0e353fa6a4c2d8b874ec7e82caba562c5b4eb648c0a27798e7ec65aaa9e736b9 WatchSource:0}: Error finding container 0e353fa6a4c2d8b874ec7e82caba562c5b4eb648c0a27798e7ec65aaa9e736b9: Status 404 returned error can't find the container with id 0e353fa6a4c2d8b874ec7e82caba562c5b4eb648c0a27798e7ec65aaa9e736b9 Nov 03 19:50:41.147797 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.147740 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4"] Nov 03 19:50:41.152497 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.151763 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6"] Nov 03 19:50:41.157235 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.156714 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz"] Nov 03 19:50:41.159461 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:41.159432 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd2844b_9872_446c_a13f_e44cf3b448f1.slice/crio-ab8840f1225607425a4702cab46f4f57366ea2ad1436e733da4f498c36e7415a WatchSource:0}: Error finding container ab8840f1225607425a4702cab46f4f57366ea2ad1436e733da4f498c36e7415a: Status 404 returned error can't find the container with id ab8840f1225607425a4702cab46f4f57366ea2ad1436e733da4f498c36e7415a Nov 03 19:50:41.161769 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.161741 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9924w"] Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.162255 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.162294 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.162332 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.162387 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.162420 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.162456 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162601 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162649 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.162631639 +0000 UTC m=+31.755041995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162712 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162745 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.162734415 +0000 UTC m=+31.755144763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162792 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162818 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.162808701 +0000 UTC m=+31.755219049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162876 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162905 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls podName:4e4667ad-2be3-4e3c-850b-fef51ceb0513 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.162895454 +0000 UTC m=+31.755305806 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-lcv5g" (UID: "4e4667ad-2be3-4e3c-850b-fef51ceb0513") : secret "samples-operator-tls" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.162989 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:41.163148 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.163001 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:41.163892 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.163033 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.16302251 +0000 UTC m=+31.755432859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:41.163892 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.163087 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:41.163892 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.163095 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:41.163892 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.163122 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.163113328 +0000 UTC m=+31.755523677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:41.167176 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:41.167153 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff8d2adc_7480_498a_8038_686b9efa537a.slice/crio-b9076516abfe7bd91901e50b5ca2e846092fc2c686bf21acc3795de0da60a39a WatchSource:0}: Error finding container b9076516abfe7bd91901e50b5ca2e846092fc2c686bf21acc3795de0da60a39a: Status 404 returned error can't find the container with id b9076516abfe7bd91901e50b5ca2e846092fc2c686bf21acc3795de0da60a39a Nov 03 19:50:41.263528 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.263440 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:41.264113 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.263547 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:41.264113 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:41.263617 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:42.263597878 +0000 UTC m=+31.856008229 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:41.363031 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:41.363010 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2"] Nov 03 19:50:41.365801 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:41.365779 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13c24d6_6885_4eb9_952c_1c366b8d775b.slice/crio-63e1972d193346fda1c1c61d70066649bad74f78201ac3293603a369de7a5cda WatchSource:0}: Error finding container 63e1972d193346fda1c1c61d70066649bad74f78201ac3293603a369de7a5cda: Status 404 returned error can't find the container with id 63e1972d193346fda1c1c61d70066649bad74f78201ac3293603a369de7a5cda Nov 03 19:50:42.071698 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.071666 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:42.072105 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.071839 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.071817598 +0000 UTC m=+33.664227947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : configmap references non-existent config key: service-ca.crt Nov 03 19:50:42.094864 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.094831 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" event={"ID":"1bd2844b-9872-446c-a13f-e44cf3b448f1","Type":"ContainerStarted","Data":"ab8840f1225607425a4702cab46f4f57366ea2ad1436e733da4f498c36e7415a"} Nov 03 19:50:42.097917 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.097844 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" event={"ID":"9300cd63-4b10-4876-96a3-7130ff5d35c7","Type":"ContainerStarted","Data":"77fbc9ef287baf897f08cdcf232fd81d10cdd75dd351ef79949cd9443d246d92"} Nov 03 19:50:42.097917 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.097880 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" event={"ID":"9300cd63-4b10-4876-96a3-7130ff5d35c7","Type":"ContainerStarted","Data":"e7919a46d7621398d20b193daad62c690427b6990d9b985b24d9e33de24a1a41"} Nov 03 19:50:42.099968 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.099943 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" event={"ID":"618261dd-822b-486a-8cd0-40b16e371320","Type":"ContainerStarted","Data":"ba8d79a60ebf4355cff1bb926cd8020e05ddfc34bec6e2109ebb7df620761aaa"} Nov 03 19:50:42.101888 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.101862 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" event={"ID":"98ee3610-e8cb-420a-a400-60cadd3d0d8c","Type":"ContainerStarted","Data":"cee4bb3d06d538bda725a5230b7b159798c6988cda515f1a3908985ef5810450"} Nov 03 19:50:42.103288 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.103263 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" event={"ID":"0541c396-e42d-45e3-abe6-70b647e84341","Type":"ContainerStarted","Data":"806eed7bfa86ec6a5cd794dfe45144a056a671088cbe787f755eceb817442155"} Nov 03 19:50:42.105197 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.104905 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" event={"ID":"616120e6-f7d2-4ca3-985d-80c1e53bc3b7","Type":"ContainerStarted","Data":"906c2a4b090f0e9710ef8bceffd18edf63fab1154f1c0d05dabb5c20ddf0ecad"} Nov 03 19:50:42.106207 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.106164 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" event={"ID":"d13c24d6-6885-4eb9-952c-1c366b8d775b","Type":"ContainerStarted","Data":"63e1972d193346fda1c1c61d70066649bad74f78201ac3293603a369de7a5cda"} Nov 03 19:50:42.107556 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.107536 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9924w" event={"ID":"ff8d2adc-7480-498a-8038-686b9efa537a","Type":"ContainerStarted","Data":"b9076516abfe7bd91901e50b5ca2e846092fc2c686bf21acc3795de0da60a39a"} Nov 03 19:50:42.108998 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.108974 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" event={"ID":"c76f66cb-43f9-4ce9-8ce4-04f241205199","Type":"ContainerStarted","Data":"0e353fa6a4c2d8b874ec7e82caba562c5b4eb648c0a27798e7ec65aaa9e736b9"} Nov 03 19:50:42.172427 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.172392 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:42.172585 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.172443 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:42.172585 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.172472 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:42.172585 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.172555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:42.172585 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.172580 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:42.172760 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.172613 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:42.172873 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.172857 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 03 19:50:42.172944 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.172910 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls podName:4e4667ad-2be3-4e3c-850b-fef51ceb0513 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.172898944 +0000 UTC m=+33.765309295 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-lcv5g" (UID: "4e4667ad-2be3-4e3c-850b-fef51ceb0513") : secret "samples-operator-tls" not found Nov 03 19:50:42.173035 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173021 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:42.173066 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173040 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:42.173097 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173073 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.17306163 +0000 UTC m=+33.765471979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:42.173147 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173135 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:42.173201 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173149 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:42.173201 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173178 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.173167797 +0000 UTC m=+33.765578149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:42.173296 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173222 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:42.173296 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173243 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.173236518 +0000 UTC m=+33.765646867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:42.173296 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173283 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:42.173430 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173301 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.173296045 +0000 UTC m=+33.765706393 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:42.173430 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173330 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:42.173430 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.173352 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.173343524 +0000 UTC m=+33.765753860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:42.274315 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.274278 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:42.275740 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.275653 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:42.275740 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:42.275715 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:44.27569576 +0000 UTC m=+33.868106109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:42.493738 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.493647 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:42.637770 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.637718 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" podStartSLOduration=401.637705406 podStartE2EDuration="6m41.637705406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:42.636782439 +0000 UTC m=+32.229192797" watchObservedRunningTime="2026-11-03 19:50:42.637705406 +0000 UTC m=+32.230115762" Nov 03 19:50:42.638127 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.638098 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" podStartSLOduration=401.638091485 podStartE2EDuration="6m41.638091485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:42.51856463 +0000 UTC m=+32.110974987" watchObservedRunningTime="2026-11-03 19:50:42.638091485 +0000 UTC m=+32.230501842" Nov 03 19:50:42.731289 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.731095 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:42.761326 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:42.760776 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" podStartSLOduration=401.760727795 podStartE2EDuration="6m41.760727795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:42.757417401 +0000 UTC m=+32.349827759" watchObservedRunningTime="2026-11-03 19:50:42.760727795 +0000 UTC m=+32.353138157" Nov 03 19:50:44.095382 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.095084 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:44.095382 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.095361 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.095341402 +0000 UTC m=+37.687751764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : configmap references non-existent config key: service-ca.crt Nov 03 19:50:44.123249 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.122498 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" event={"ID":"98ee3610-e8cb-420a-a400-60cadd3d0d8c","Type":"ContainerStarted","Data":"aa61de76a851c109cc5a3db46ff6ba0c6b274d9688fae36c6af9da3ee80d93b4"} Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.196429 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.196476 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.196517 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.196577 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.196616 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.196653 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.196856 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.196920 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.196902603 +0000 UTC m=+37.789312961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197299 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197346 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.197331963 +0000 UTC m=+37.789742315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197401 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197436 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.197425533 +0000 UTC m=+37.789835881 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197487 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197519 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls podName:4e4667ad-2be3-4e3c-850b-fef51ceb0513 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.197509489 +0000 UTC m=+37.789919840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-lcv5g" (UID: "4e4667ad-2be3-4e3c-850b-fef51ceb0513") : secret "samples-operator-tls" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197577 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:44.197779 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197588 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:44.198831 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197619 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.197609616 +0000 UTC m=+37.790019965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:44.198831 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197687 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:44.198831 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197697 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:44.198831 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.197729 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.197718526 +0000 UTC m=+37.790128875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:44.242796 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.242701 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" podStartSLOduration=391.604481653 podStartE2EDuration="6m34.242682556s" totalImagesPullingTime="2.638200903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:44.240633365 +0000 UTC m=+33.833043724" watchObservedRunningTime="2026-11-03 19:50:44.242682556 +0000 UTC m=+33.835092913" Nov 03 19:50:44.297531 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.297494 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:44.297759 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.297740 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:44.297832 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.297810 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.297790443 +0000 UTC m=+37.890200784 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:44.378417 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.378278 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:44.616893 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.616860 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:44.703494 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.702868 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:44.703494 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.703189 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 19:50:44.703494 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:44.703252 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:51:16.703234612 +0000 UTC m=+66.295644947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : secret "metrics-daemon-secret" not found Nov 03 19:50:44.804196 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.804162 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:44.818053 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.818017 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:44.843919 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.843890 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:44.905248 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.905200 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:44.909521 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:44.909465 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:45.031677 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:45.031605 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:45.087663 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:45.087630 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:45.092784 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:45.092739 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:45.559389 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:45.559336 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jllnn"] Nov 03 19:50:45.574256 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:45.574220 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ac74a8_8df8_48fd_8a09_9ce51991bd84.slice/crio-a1c83af40a9f5e2cea86fe9792495864521afc3058ffc5598a2b9657abf38d06 WatchSource:0}: Error finding container a1c83af40a9f5e2cea86fe9792495864521afc3058ffc5598a2b9657abf38d06: Status 404 returned error can't find the container with id a1c83af40a9f5e2cea86fe9792495864521afc3058ffc5598a2b9657abf38d06 Nov 03 19:50:45.612292 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:45.612268 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rnq79"] Nov 03 19:50:45.626277 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:45.626250 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1c6275_037e_44d2_89c0_8bb80d832a11.slice/crio-35a0916c9023b47a5f2e731737289fa9d1589e02a2abae9957f134138d99f5a2 WatchSource:0}: Error finding container 35a0916c9023b47a5f2e731737289fa9d1589e02a2abae9957f134138d99f5a2: Status 404 returned error can't find the container with id 35a0916c9023b47a5f2e731737289fa9d1589e02a2abae9957f134138d99f5a2 Nov 03 19:50:46.132562 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.132524 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5tccb" event={"ID":"811da5af-e26c-482c-99c3-14202b7d524e","Type":"ContainerStarted","Data":"f5d0c20ab6a8e71d6391af02325f666697dc9a4242c013d36f206162b9ab0737"} Nov 03 19:50:46.135249 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.135224 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/0.log" Nov 03 19:50:46.135342 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.135263 2571 generic.go:356] "Generic (PLEG): container finished" podID="c76f66cb-43f9-4ce9-8ce4-04f241205199" containerID="7ba69c3447fe5ce692d590a732e8183912903b79c36a4d422b8bcb895a80a3f9" exitCode=255 Nov 03 19:50:46.135400 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.135346 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" event={"ID":"c76f66cb-43f9-4ce9-8ce4-04f241205199","Type":"ContainerDied","Data":"7ba69c3447fe5ce692d590a732e8183912903b79c36a4d422b8bcb895a80a3f9"} Nov 03 19:50:46.135658 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.135641 2571 scope.go:122] "RemoveContainer" containerID="7ba69c3447fe5ce692d590a732e8183912903b79c36a4d422b8bcb895a80a3f9" Nov 03 19:50:46.138674 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.138655 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rnq79" event={"ID":"bb1c6275-037e-44d2-89c0-8bb80d832a11","Type":"ContainerStarted","Data":"35a0916c9023b47a5f2e731737289fa9d1589e02a2abae9957f134138d99f5a2"} Nov 03 19:50:46.140058 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.140039 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jllnn" event={"ID":"62ac74a8-8df8-48fd-8a09-9ce51991bd84","Type":"ContainerStarted","Data":"a1c83af40a9f5e2cea86fe9792495864521afc3058ffc5598a2b9657abf38d06"} Nov 03 19:50:46.253313 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:46.253269 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-5tccb" podStartSLOduration=389.271067244 podStartE2EDuration="6m34.253256173s" totalImagesPullingTime="4.982188929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:46.252302831 +0000 UTC m=+35.844713189" watchObservedRunningTime="2026-11-03 19:50:46.253256173 +0000 UTC m=+35.845666529" Nov 03 19:50:47.148268 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.148012 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" event={"ID":"0541c396-e42d-45e3-abe6-70b647e84341","Type":"ContainerStarted","Data":"067511dede6df3d077ae04943e82a2931eddad6e360be00b839ac26d4eb91ef6"} Nov 03 19:50:47.152102 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.152038 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" event={"ID":"d13c24d6-6885-4eb9-952c-1c366b8d775b","Type":"ContainerStarted","Data":"328de065d3932a3100261b84ff617ff7cb320e27ef8b134104f97e514f5abfe9"} Nov 03 19:50:47.155955 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.155461 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9924w" event={"ID":"ff8d2adc-7480-498a-8038-686b9efa537a","Type":"ContainerStarted","Data":"6a5b5d3d3f4525b348029651a839f1a16974ffe9c51216d0b84137aeca888c59"} Nov 03 19:50:47.158120 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.158060 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/1.log" Nov 03 19:50:47.159787 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.158683 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/0.log" Nov 03 19:50:47.159787 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.158717 2571 generic.go:356] "Generic (PLEG): container finished" podID="c76f66cb-43f9-4ce9-8ce4-04f241205199" containerID="fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b" exitCode=255 Nov 03 19:50:47.159787 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.159405 2571 scope.go:122] "RemoveContainer" containerID="fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b" Nov 03 19:50:47.159787 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:47.159571 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-7bmz4_openshift-console-operator(c76f66cb-43f9-4ce9-8ce4-04f241205199)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" podUID="c76f66cb-43f9-4ce9-8ce4-04f241205199" Nov 03 19:50:47.159787 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.159623 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" event={"ID":"c76f66cb-43f9-4ce9-8ce4-04f241205199","Type":"ContainerDied","Data":"fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b"} Nov 03 19:50:47.159787 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.159661 2571 scope.go:122] "RemoveContainer" containerID="7ba69c3447fe5ce692d590a732e8183912903b79c36a4d422b8bcb895a80a3f9" Nov 03 19:50:47.277258 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.277186 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" podStartSLOduration=391.625324664 podStartE2EDuration="6m37.277166354s" totalImagesPullingTime="5.65184169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:47.274592551 +0000 UTC m=+36.867002907" watchObservedRunningTime="2026-11-03 19:50:47.277166354 +0000 UTC m=+36.869576716" Nov 03 19:50:47.334948 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.331751 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dhz4z"] Nov 03 19:50:47.353090 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.353065 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.395420 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.395386 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dhz4z"] Nov 03 19:50:47.417192 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.417123 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 19:50:47.417192 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.417191 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 19:50:47.417376 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.417286 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzphm\"" Nov 03 19:50:47.434597 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.433082 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-data-volume\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.434597 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.433136 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.434597 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.433167 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m42nx\" (UniqueName: \"kubernetes.io/projected/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-api-access-m42nx\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.434597 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.433223 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.434597 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.433320 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-crio-socket\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.523168 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.522144 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" podStartSLOduration=395.103179479 podStartE2EDuration="6m40.522127892s" totalImagesPullingTime="5.418948413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:47.397113683 +0000 UTC m=+36.989524039" watchObservedRunningTime="2026-11-03 19:50:47.522127892 +0000 UTC m=+37.114538248" Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.534005 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-data-volume\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.534064 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.534094 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m42nx\" (UniqueName: \"kubernetes.io/projected/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-api-access-m42nx\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.534144 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.534240 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-crio-socket\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.534345 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-crio-socket\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:47.534703 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:47.534751 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:47.534778 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.034759144 +0000 UTC m=+37.627169491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : configmap "kube-rbac-proxy" not found Nov 03 19:50:47.534875 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:47.534810 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:48.034793395 +0000 UTC m=+37.627203736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:47.535597 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.535561 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-data-volume\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.574553 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.574520 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-p7nwb-5jxp7"] Nov 03 19:50:47.585480 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.585425 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:47.594788 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.594762 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.597102 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.597081 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m42nx\" (UniqueName: \"kubernetes.io/projected/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-api-access-m42nx\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:47.636431 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.636394 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.636562 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.636441 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.636562 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.636512 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.636622 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.636612 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkbn9\" (UniqueName: \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.637470 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.637450 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-p7nwb-5jxp7"] Nov 03 19:50:47.642300 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.642250 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9924w" podStartSLOduration=2.02442237 podStartE2EDuration="7.642234105s" totalImagesPullingTime="5.617811735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:47.641185014 +0000 UTC m=+37.233595371" watchObservedRunningTime="2026-11-03 19:50:47.642234105 +0000 UTC m=+37.234644463" Nov 03 19:50:47.648388 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.648345 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5c7z7\"" Nov 03 19:50:47.738225 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.738143 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkbn9\" (UniqueName: \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.738376 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.738334 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.738376 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.738365 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.738491 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.738413 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.739505 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.738766 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.739505 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.739101 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.739505 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.739469 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.801341 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.801308 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkbn9\" (UniqueName: \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:47.815350 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.815318 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:47.928666 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:47.928626 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:48.041871 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.041846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:48.042026 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.041896 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:48.042240 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.042126 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:48.042240 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.042142 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:48.042240 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.042200 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:49.042181525 +0000 UTC m=+38.634591860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:48.042240 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.042217 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:49.042208145 +0000 UTC m=+38.634618480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : configmap "kube-rbac-proxy" not found Nov 03 19:50:48.143582 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.143272 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:48.143582 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.143536 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.143517214 +0000 UTC m=+45.735927563 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : configmap references non-existent config key: service-ca.crt Nov 03 19:50:48.164649 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.164622 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/1.log" Nov 03 19:50:48.165097 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.165002 2571 scope.go:122] "RemoveContainer" containerID="fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b" Nov 03 19:50:48.165259 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.165238 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-7bmz4_openshift-console-operator(c76f66cb-43f9-4ce9-8ce4-04f241205199)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" podUID="c76f66cb-43f9-4ce9-8ce4-04f241205199" Nov 03 19:50:48.166618 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.166590 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" event={"ID":"1bd2844b-9872-446c-a13f-e44cf3b448f1","Type":"ContainerStarted","Data":"f479f1e62f3349065c08d83395fde2fa3fccacb61c5e7fa7fdefd9be1eae0675"} Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.243874 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.244016 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.244069 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.244134 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.244313 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.244331 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.244439 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.244497 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.244481275 +0000 UTC m=+45.836891647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.244580 2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.244613 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls podName:4e4667ad-2be3-4e3c-850b-fef51ceb0513 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.244602946 +0000 UTC m=+45.837013295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-lcv5g" (UID: "4e4667ad-2be3-4e3c-850b-fef51ceb0513") : secret "samples-operator-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.245584 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.245599 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.245638 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.245624358 +0000 UTC m=+45.838034706 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.245842 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.245852 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.245882 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.245871334 +0000 UTC m=+45.838281675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:48.247470 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.246109 2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:48.248209 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.246147 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.246135501 +0000 UTC m=+45.838545850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:48.248209 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.247393 2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:48.248209 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.247431 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.247418652 +0000 UTC m=+45.839829001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:48.307330 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.307241 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:48.345480 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.345439 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:48.345727 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.345707 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:48.345794 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:48.345780 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:56.345762565 +0000 UTC m=+45.938172916 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:48.348614 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.348463 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-p7nwb-5jxp7"] Nov 03 19:50:48.351284 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:48.351261 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852d63c2_7941_4726_8d8b_2a1aad748f1a.slice/crio-471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f WatchSource:0}: Error finding container 471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f: Status 404 returned error can't find the container with id 471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f Nov 03 19:50:48.445898 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.445846 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" podStartSLOduration=371.447985135 podStartE2EDuration="6m17.445830559s" totalImagesPullingTime="5.997845424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:48.444220676 +0000 UTC m=+38.036631035" watchObservedRunningTime="2026-11-03 19:50:48.445830559 +0000 UTC m=+38.038240915" Nov 03 19:50:48.462820 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.462795 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg"] Nov 03 19:50:48.480051 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.480025 2571 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm"] Nov 03 19:50:48.480256 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.480243 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" Nov 03 19:50:48.505689 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.505370 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" Nov 03 19:50:48.528217 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.528190 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg"] Nov 03 19:50:48.532045 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.531916 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:48.535835 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.535809 2571 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tvtfw\"" Nov 03 19:50:48.536141 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.536026 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:48.536141 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.536113 2571 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 03 19:50:48.540778 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.540753 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm"] Nov 03 19:50:48.548171 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.548144 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b28h\" (UniqueName: \"kubernetes.io/projected/6541125d-1dbc-4699-a07b-3ce05823ca0a-kube-api-access-9b28h\") pod \"migrator-66df5d496b-r77zm\" (UID: \"6541125d-1dbc-4699-a07b-3ce05823ca0a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" Nov 03 19:50:48.548432 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.548411 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6dnv\" (UniqueName: \"kubernetes.io/projected/302d2c96-e159-4e58-9923-ceadd49d60b5-kube-api-access-z6dnv\") pod \"migrator-66df5d496b-x7ftg\" (UID: \"302d2c96-e159-4e58-9923-ceadd49d60b5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" Nov 03 19:50:48.650487 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.649340 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b28h\" (UniqueName: \"kubernetes.io/projected/6541125d-1dbc-4699-a07b-3ce05823ca0a-kube-api-access-9b28h\") pod \"migrator-66df5d496b-r77zm\" (UID: \"6541125d-1dbc-4699-a07b-3ce05823ca0a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" Nov 03 19:50:48.650487 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.649524 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6dnv\" (UniqueName: \"kubernetes.io/projected/302d2c96-e159-4e58-9923-ceadd49d60b5-kube-api-access-z6dnv\") pod \"migrator-66df5d496b-x7ftg\" (UID: \"302d2c96-e159-4e58-9923-ceadd49d60b5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" Nov 03 19:50:48.712532 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.712502 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b28h\" (UniqueName: \"kubernetes.io/projected/6541125d-1dbc-4699-a07b-3ce05823ca0a-kube-api-access-9b28h\") pod \"migrator-66df5d496b-r77zm\" (UID: \"6541125d-1dbc-4699-a07b-3ce05823ca0a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" Nov 03 19:50:48.718680 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.718652 2571 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6dnv\" (UniqueName: \"kubernetes.io/projected/302d2c96-e159-4e58-9923-ceadd49d60b5-kube-api-access-z6dnv\") pod \"migrator-66df5d496b-x7ftg\" (UID: \"302d2c96-e159-4e58-9923-ceadd49d60b5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" Nov 03 19:50:48.807397 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.807360 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:48.816423 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.816397 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" Nov 03 19:50:48.840130 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:48.840110 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" Nov 03 19:50:49.053060 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.053020 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:49.053241 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.053106 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:49.053241 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:49.053146 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:49.053241 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:49.053214 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:51.053197395 +0000 UTC m=+40.645607747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : configmap "kube-rbac-proxy" not found Nov 03 19:50:49.053357 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:49.053270 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:49.053357 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:49.053320 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:51.053305882 +0000 UTC m=+40.645716235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:49.172291 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.172197 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" event={"ID":"852d63c2-7941-4726-8d8b-2a1aad748f1a","Type":"ContainerStarted","Data":"2f7fd2655ae425a3965d1a745117fba23f8f85d4645cf47704403290cf698b91"} Nov 03 19:50:49.172291 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.172268 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" event={"ID":"852d63c2-7941-4726-8d8b-2a1aad748f1a","Type":"ContainerStarted","Data":"471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f"} Nov 03 19:50:49.231550 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.231467 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg"] Nov 03 19:50:49.233115 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:49.233084 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302d2c96_e159_4e58_9923_ceadd49d60b5.slice/crio-49ace7c20c5f150e398dd8c808396f7be31dc14c7748d1d92d7a7fa51b84aed5 WatchSource:0}: Error finding container 49ace7c20c5f150e398dd8c808396f7be31dc14c7748d1d92d7a7fa51b84aed5: Status 404 returned error can't find the container with id 49ace7c20c5f150e398dd8c808396f7be31dc14c7748d1d92d7a7fa51b84aed5 Nov 03 19:50:49.275056 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.275031 2571 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm"] Nov 03 19:50:49.279064 ip-10-0-131-64 kubenswrapper[2571]: W1103 19:50:49.279035 2571 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6541125d_1dbc_4699_a07b_3ce05823ca0a.slice/crio-0e3585f4f2239a98aabfed18bf2d7b14da52d2ca5d35c69f5942a6fa1ef5906d WatchSource:0}: Error finding container 0e3585f4f2239a98aabfed18bf2d7b14da52d2ca5d35c69f5942a6fa1ef5906d: Status 404 returned error can't find the container with id 0e3585f4f2239a98aabfed18bf2d7b14da52d2ca5d35c69f5942a6fa1ef5906d Nov 03 19:50:49.298975 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.298904 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" podStartSLOduration=2.298886277 podStartE2EDuration="2.298886277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:49.297438255 +0000 UTC m=+38.889848611" watchObservedRunningTime="2026-11-03 19:50:49.298886277 +0000 UTC m=+38.891296636" Nov 03 19:50:49.594421 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.594382 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:49.793299 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:49.793211 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:50.177794 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.177761 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" event={"ID":"6541125d-1dbc-4699-a07b-3ce05823ca0a","Type":"ContainerStarted","Data":"0e3585f4f2239a98aabfed18bf2d7b14da52d2ca5d35c69f5942a6fa1ef5906d"} Nov 03 19:50:50.179186 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.179153 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" event={"ID":"302d2c96-e159-4e58-9923-ceadd49d60b5","Type":"ContainerStarted","Data":"49ace7c20c5f150e398dd8c808396f7be31dc14c7748d1d92d7a7fa51b84aed5"} Nov 03 19:50:50.180817 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.180791 2571 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rnq79" event={"ID":"bb1c6275-037e-44d2-89c0-8bb80d832a11","Type":"ContainerStarted","Data":"d71c13fbef02acf280438f3e9ad4392977b7d395c3557d73a69fa1c17f89fc4a"} Nov 03 19:50:50.300195 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.300027 2571 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rnq79" podStartSLOduration=35.512317297 podStartE2EDuration="39.300005941s" totalImagesPullingTime="3.787688644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:50:50.298629094 +0000 UTC m=+39.891039450" watchObservedRunningTime="2026-11-03 19:50:50.300005941 +0000 UTC m=+39.892416298" Nov 03 19:50:50.637525 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.637495 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:50.690132 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.690080 2571 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:50.690308 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.690151 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:50.690627 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:50.690606 2571 scope.go:122] "RemoveContainer" containerID="fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b" Nov 03 19:50:50.690863 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:50.690840 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-7bmz4_openshift-console-operator(c76f66cb-43f9-4ce9-8ce4-04f241205199)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" podUID="c76f66cb-43f9-4ce9-8ce4-04f241205199" Nov 03 19:50:51.076290 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:51.076200 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:51.076453 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:51.076415 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:51.076453 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:51.076429 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:51.076559 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:51.076502 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.076481876 +0000 UTC m=+44.668892230 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:51.076559 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:51.076501 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:51.076559 ip-10-0-131-64 kubenswrapper[2571]: E1103 19:50:51.076555 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.076542779 +0000 UTC m=+44.668953116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : configmap "kube-rbac-proxy" not found Nov 03 19:50:51.184126 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:51.184098 2571 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:52.074155 ip-10-0-131-64 kubenswrapper[2571]: I1103 19:50:52.074113 2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:52.133181 ip-10-0-131-64 systemd[1]: Stopping Kubernetes Kubelet... Nov 03 19:50:52.146333 ip-10-0-131-64 systemd[1]: kubelet.service: Deactivated successfully. Nov 03 19:50:52.146543 ip-10-0-131-64 systemd[1]: Stopped Kubernetes Kubelet. Nov 03 19:50:52.146736 ip-10-0-131-64 systemd[1]: kubelet.service: Consumed 3.073s CPU time. Nov 03 19:50:52.156646 ip-10-0-131-64 systemd[1]: Starting Kubernetes Kubelet... Nov 03 19:50:52.247022 ip-10-0-131-64 kubenswrapper[5024]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:52.247022 ip-10-0-131-64 kubenswrapper[5024]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 03 19:50:52.247022 ip-10-0-131-64 kubenswrapper[5024]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:52.247022 ip-10-0-131-64 kubenswrapper[5024]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 03 19:50:52.249010 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.248913 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.249010 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249010 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249015 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249018 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249021 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249024 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249027 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249029 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249031 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249034 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249036 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249039 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249042 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249044 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249047 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249049 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249051 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249054 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249056 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249058 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.249085 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249061 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249063 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249066 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249068 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249070 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249073 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249079 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249081 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249084 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249086 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249089 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249092 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249094 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249097 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249100 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249103 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249105 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249107 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249110 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249112 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.249574 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249114 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249125 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249128 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249130 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249132 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249135 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249138 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249140 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249143 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249145 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249148 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249152 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249154 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249157 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249160 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249164 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249167 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249170 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249173 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.250094 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249175 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249178 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249180 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249183 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249185 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249187 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249190 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249192 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249195 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249198 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249201 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249203 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249206 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249209 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249211 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249214 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249216 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249219 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249222 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.250555 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249227 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249231 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249233 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249236 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249239 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249241 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249243 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249246 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249249 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249251 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249254 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249256 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249258 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249261 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249263 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249266 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249268 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249270 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249273 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249275 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.251067 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249277 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249280 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249283 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249286 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249288 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249292 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249294 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.249296 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250055 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250062 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250065 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250068 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250071 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250074 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250078 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250081 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250084 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250087 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250089 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250092 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.251557 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250095 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250098 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250101 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250103 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250106 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250108 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250112 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250116 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250118 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250122 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250124 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250127 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250129 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250132 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250135 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250137 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250140 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250143 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250145 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.252082 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250147 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250150 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250152 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250154 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250157 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250159 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250161 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250164 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250167 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250169 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250172 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250174 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250177 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250179 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250182 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250185 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250187 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250189 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250192 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250194 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.252554 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250196 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250199 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250201 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250204 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250206 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250208 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250211 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250213 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250215 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250217 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250220 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250222 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250224 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250227 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250229 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250232 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250235 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250237 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250241 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250243 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.253062 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250246 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250248 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250250 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250253 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250255 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250258 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250260 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250263 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250266 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250268 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250270 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250273 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250275 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250277 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250280 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250282 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250285 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250287 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250289 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.253542 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250291 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250294 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250296 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250298 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250301 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250303 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250306 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250308 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250312 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250314 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250317 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250319 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250322 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250324 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250327 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250330 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250788 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250793 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250795 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.254023 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250798 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250801 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250804 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250807 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250809 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250811 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250814 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250816 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250819 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250821 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250824 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250826 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250828 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250831 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250833 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250836 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250838 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250841 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250844 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250846 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.254483 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250849 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250852 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250854 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250857 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250859 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250861 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250864 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250866 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250868 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250871 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250873 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250875 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250878 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250880 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250883 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250885 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250887 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250890 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250893 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250895 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.255257 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250897 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250900 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250903 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250905 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250907 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250910 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250912 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250914 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250917 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250919 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250939 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250945 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250948 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250951 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250953 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250956 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250959 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250961 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250963 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.256114 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250966 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250968 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250971 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250973 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250976 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250980 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250984 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250987 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250990 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250994 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250996 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.250999 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251001 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251004 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251007 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251010 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251013 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251015 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251017 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.256709 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251020 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251022 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251025 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251027 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251030 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251033 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251036 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251038 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251041 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251043 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251046 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251048 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251051 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251053 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251055 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251057 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251060 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251064 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251068 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251070 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.257238 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251073 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251076 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251078 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251081 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251084 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251169 5024 flags.go:64] FLAG: --address="0.0.0.0" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251180 5024 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251186 5024 flags.go:64] FLAG: --anonymous-auth="true" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251190 5024 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251194 5024 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251197 5024 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251201 5024 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251205 5024 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251208 5024 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251211 5024 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251214 5024 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251217 5024 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251221 5024 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251224 5024 flags.go:64] FLAG: --cgroup-root="" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251227 5024 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251231 5024 flags.go:64] FLAG: --client-ca-file="" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251233 5024 flags.go:64] FLAG: --cloud-provider="external" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251236 5024 flags.go:64] FLAG: --cluster-dns="[]" Nov 03 19:50:52.257715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251240 5024 flags.go:64] FLAG: --cluster-domain="" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251243 5024 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251246 5024 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251249 5024 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251252 5024 flags.go:64] FLAG: --container-log-max-files="5" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251255 5024 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251258 5024 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251261 5024 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251264 5024 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251267 5024 flags.go:64] FLAG: --contention-profiling="false" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251270 5024 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251272 5024 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251276 5024 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251279 5024 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251283 5024 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251286 5024 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251288 5024 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251291 5024 flags.go:64] FLAG: --enable-load-reader="false" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251294 5024 flags.go:64] FLAG: --enable-server="true" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251296 5024 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251300 5024 flags.go:64] FLAG: --event-burst="100" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251304 5024 flags.go:64] FLAG: --event-qps="50" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251306 5024 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251309 5024 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 03 19:50:52.258283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251312 5024 flags.go:64] FLAG: --eviction-hard="" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251316 5024 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251320 5024 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251323 5024 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251326 5024 flags.go:64] FLAG: --eviction-soft="" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251330 5024 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251333 5024 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251336 5024 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251338 5024 flags.go:64] FLAG: --experimental-mounter-path="" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251341 5024 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251344 5024 flags.go:64] FLAG: --fail-swap-on="true" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251347 5024 flags.go:64] FLAG: --feature-gates="" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251350 5024 flags.go:64] FLAG: --file-check-frequency="20s" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251353 5024 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251356 5024 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251359 5024 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251362 5024 flags.go:64] FLAG: --healthz-port="10248" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251365 5024 flags.go:64] FLAG: --help="false" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251368 5024 flags.go:64] FLAG: --hostname-override="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251371 5024 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251374 5024 flags.go:64] FLAG: --http-check-frequency="20s" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251377 5024 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251380 5024 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 03 19:50:52.258865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251384 5024 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251386 5024 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251389 5024 flags.go:64] FLAG: --image-service-endpoint="" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251391 5024 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251394 5024 flags.go:64] FLAG: --kube-api-burst="100" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251397 5024 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251399 5024 flags.go:64] FLAG: --kube-api-qps="50" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251402 5024 flags.go:64] FLAG: --kube-reserved="" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251405 5024 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251408 5024 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251410 5024 flags.go:64] FLAG: --kubelet-cgroups="" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251416 5024 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251419 5024 flags.go:64] FLAG: --lock-file="" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251421 5024 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251429 5024 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251432 5024 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251437 5024 flags.go:64] FLAG: --log-json-split-stream="false" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251440 5024 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251444 5024 flags.go:64] FLAG: --log-text-split-stream="false" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251447 5024 flags.go:64] FLAG: --logging-format="text" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251449 5024 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251452 5024 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251455 5024 flags.go:64] FLAG: --manifest-url="" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251458 5024 flags.go:64] FLAG: --manifest-url-header="" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251462 5024 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 03 19:50:52.259440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251465 5024 flags.go:64] FLAG: --max-open-files="1000000" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251469 5024 flags.go:64] FLAG: --max-pods="110" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251472 5024 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251475 5024 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251478 5024 flags.go:64] FLAG: --memory-manager-policy="None" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251480 5024 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251488 5024 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251491 5024 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251494 5024 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251501 5024 flags.go:64] FLAG: --node-status-max-images="50" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251503 5024 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251506 5024 flags.go:64] FLAG: --oom-score-adj="-999" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251509 5024 flags.go:64] FLAG: --pod-cidr="" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251512 5024 flags.go:64] FLAG: --pod-manifest-path="" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251515 5024 flags.go:64] FLAG: --pod-max-pids="-1" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251517 5024 flags.go:64] FLAG: --pods-per-core="0" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251520 5024 flags.go:64] FLAG: --port="10250" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251523 5024 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251527 5024 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0c17e1e84ca8d6317" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251530 5024 flags.go:64] FLAG: --qos-reserved="" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251532 5024 flags.go:64] FLAG: --read-only-port="10255" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251537 5024 flags.go:64] FLAG: --register-node="true" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251540 5024 flags.go:64] FLAG: --register-with-taints="" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251543 5024 flags.go:64] FLAG: --registry-burst="10" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251546 5024 flags.go:64] FLAG: --registry-qps="5" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251549 5024 flags.go:64] FLAG: --reserved-cpus="" Nov 03 19:50:52.260062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251551 5024 flags.go:64] FLAG: --reserved-memory="" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251554 5024 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251557 5024 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251560 5024 flags.go:64] FLAG: --rotate-certificates="false" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251563 5024 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251566 5024 flags.go:64] FLAG: --runonce="false" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251569 5024 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251572 5024 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251575 5024 flags.go:64] FLAG: --seccomp-default="false" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251578 5024 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251581 5024 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251584 5024 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251587 5024 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251590 5024 flags.go:64] FLAG: --storage-driver-password="root" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251593 5024 flags.go:64] FLAG: --storage-driver-secure="false" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251595 5024 flags.go:64] FLAG: --storage-driver-table="stats" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251598 5024 flags.go:64] FLAG: --storage-driver-user="root" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251600 5024 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251604 5024 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251606 5024 flags.go:64] FLAG: --system-cgroups="" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251609 5024 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251614 5024 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251617 5024 flags.go:64] FLAG: --tls-cert-file="" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251619 5024 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251624 5024 flags.go:64] FLAG: --tls-min-version="" Nov 03 19:50:52.260676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251627 5024 flags.go:64] FLAG: --tls-private-key-file="" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251630 5024 flags.go:64] FLAG: --topology-manager-policy="none" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251634 5024 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251637 5024 flags.go:64] FLAG: --topology-manager-scope="container" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251640 5024 flags.go:64] FLAG: --v="2" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251648 5024 flags.go:64] FLAG: --version="false" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251651 5024 flags.go:64] FLAG: --vmodule="" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251655 5024 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.251658 5024 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251806 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251811 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251815 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251817 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251820 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251823 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251825 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251828 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251830 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251832 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251834 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251837 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251840 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.261311 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251842 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251845 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251847 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251850 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251852 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251855 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251857 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251860 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251862 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251866 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251868 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251871 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251875 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251877 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251880 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251882 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251884 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251887 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251889 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251891 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.261963 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251894 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251896 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251899 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251901 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251904 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251906 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251908 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251911 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251913 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251915 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251918 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251920 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251941 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251945 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251949 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251952 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251954 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251956 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251959 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251961 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.262646 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251964 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251968 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251970 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251972 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251976 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251978 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251981 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251983 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251986 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251988 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251990 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251993 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251995 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.251998 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252012 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252016 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252019 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252021 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252024 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.263382 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252026 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252029 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252032 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252034 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252036 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252039 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252041 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252044 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252047 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252050 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252054 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252057 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252060 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252063 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252067 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252069 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252071 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252075 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252077 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.263844 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252080 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252082 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252085 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252087 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252090 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252092 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252095 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252097 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252101 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252105 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252108 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252111 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252113 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252116 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252118 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.264425 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.252144 5024 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252179 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252183 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252187 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252190 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252193 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252196 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252198 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252201 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252203 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252206 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252208 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252211 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252215 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252217 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252221 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252224 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252226 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252229 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.264851 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252231 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252234 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252236 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252238 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252241 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252243 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252247 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252250 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252253 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252255 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252258 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252260 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252262 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252265 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252267 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252269 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252272 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252274 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252276 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.265504 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252279 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252282 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252284 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252286 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252289 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252293 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252296 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252300 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252303 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252307 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252310 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252312 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252315 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252317 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252320 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252323 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252325 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252328 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252330 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.265989 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252333 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252335 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252337 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252340 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252342 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252345 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252347 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252349 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252352 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252355 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252357 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252360 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252362 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252365 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252368 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252370 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252372 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252375 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252377 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252379 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.266434 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252383 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252385 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252389 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252392 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252394 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252396 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252399 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252401 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252404 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252406 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252409 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252411 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252414 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252416 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252418 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252421 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252423 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252426 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252428 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252430 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.266916 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252433 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252436 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252438 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252441 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252443 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252445 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252448 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252451 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252453 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.252455 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.257643 5024 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.257657 5024 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.257675 5024 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.257680 5024 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257735 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257740 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257743 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257745 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257748 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257750 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.267496 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257753 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257756 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257758 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257761 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257763 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257766 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257768 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257770 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257773 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257776 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257779 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257781 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257784 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257787 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257789 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257792 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257794 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257796 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257799 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257802 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.268304 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257815 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257818 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257820 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257823 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257825 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257828 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257830 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257833 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257835 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257838 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257841 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257843 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257845 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257848 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257850 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257852 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257855 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257857 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257860 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257862 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.269096 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257865 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257868 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257870 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257873 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257875 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257879 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257881 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257883 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257886 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257888 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257891 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257893 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257895 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257897 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257900 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257902 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257904 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257906 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257910 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.269576 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257914 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257916 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257920 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257939 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257942 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257945 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257948 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257950 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257953 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257955 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257958 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257960 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257963 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257965 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257969 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257972 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257975 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257977 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257979 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.270053 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257982 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257984 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257988 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257991 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257995 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.257997 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258000 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258003 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258005 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258008 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258010 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258013 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258015 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258018 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258020 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258022 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258024 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258027 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258029 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.270569 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258031 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258034 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258036 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.258062 5024 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258207 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258212 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258214 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258217 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258219 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258222 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258225 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258227 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258229 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258232 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258234 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258237 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.271034 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258239 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258242 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258244 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258246 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258248 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258251 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258253 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258256 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258259 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258261 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258263 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258267 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258271 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258273 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258276 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258278 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258281 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258284 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258286 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.271415 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258289 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258291 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258294 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258296 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258299 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258301 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258303 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258306 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258309 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258311 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258313 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258316 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258318 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258321 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258323 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258326 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258328 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258330 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258333 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258335 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.271880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258337 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258339 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258342 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258344 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258346 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258349 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258351 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258353 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258356 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258358 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258360 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258363 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258365 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258368 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258372 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258375 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258377 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258380 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258383 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.272454 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258386 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258390 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258392 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258395 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258397 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258399 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258402 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258404 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258406 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258409 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258411 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258413 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258415 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258418 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258420 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258423 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258425 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258427 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258429 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258432 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.272914 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258434 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258436 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258439 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258441 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258443 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258445 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258448 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258450 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258452 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258455 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258457 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258460 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258462 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258464 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258467 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258470 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.273493 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.258493 5024 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258523 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258527 5024 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258529 5024 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258532 5024 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258535 5024 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258538 5024 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258540 5024 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258542 5024 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258545 5024 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258547 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258549 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258552 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258554 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258556 5024 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258559 5024 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258561 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258566 5024 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258568 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258571 5024 feature_gate.go:386] unrecognized feature gate: Example Nov 03 19:50:52.273880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258573 5024 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258576 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258578 5024 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258582 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258584 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258586 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258589 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258592 5024 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258596 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258599 5024 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258602 5024 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258605 5024 feature_gate.go:386] unrecognized feature gate: Example2 Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258608 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258611 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258614 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258617 5024 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258619 5024 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258621 5024 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258624 5024 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 03 19:50:52.274381 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258626 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258628 5024 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258631 5024 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258634 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258636 5024 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258638 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258641 5024 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258644 5024 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258646 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258649 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258652 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258655 5024 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258657 5024 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258660 5024 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258662 5024 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258664 5024 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258668 5024 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258670 5024 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258672 5024 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258675 5024 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 03 19:50:52.274859 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258677 5024 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258679 5024 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258682 5024 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258684 5024 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258687 5024 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258690 5024 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258692 5024 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258694 5024 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258697 5024 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258700 5024 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258703 5024 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258706 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258708 5024 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258711 5024 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258713 5024 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258716 5024 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258718 5024 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258720 5024 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258722 5024 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258725 5024 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 03 19:50:52.275404 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258727 5024 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258729 5024 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258733 5024 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258735 5024 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258738 5024 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258740 5024 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258742 5024 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258745 5024 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258749 5024 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258752 5024 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258754 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258758 5024 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258762 5024 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258765 5024 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258769 5024 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258775 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258779 5024 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258782 5024 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258785 5024 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258787 5024 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 03 19:50:52.275880 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258790 5024 feature_gate.go:386] unrecognized feature gate: EVPN Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258792 5024 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258795 5024 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258797 5024 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258800 5024 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258802 5024 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258805 5024 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:52.258807 5024 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.258863 5024 server.go:957] "Client rotation is on, will bootstrap in background" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.259790 5024 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.259836 5024 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.260038 5024 server.go:1014] "Starting client certificate rotation" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.260168 5024 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.260223 5024 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-02 19:45:11 +0000 UTC" deadline="2028-08-18 23:18:59.948965642 +0000 UTC" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.260256 5024 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15699h28m7.688711168s" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.260468 5024 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:52.276365 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.261503 5024 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 03 19:50:52.276955 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.262698 5024 log.go:25] "Validated CRI v1 runtime API" Nov 03 19:50:52.276955 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.264336 5024 log.go:25] "Validated CRI v1 image API" Nov 03 19:50:52.276955 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.265041 5024 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 03 19:50:52.276955 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.266971 5024 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a500aa42-fdca-4169-b49c-2f67da2c7ab5:/dev/nvme0n1p3 a89ea54e-bb20-4e28-bc99-8d909afe089e:/dev/nvme0n1p4] Nov 03 19:50:52.277085 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.266991 5024 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e353fa6a4c2d8b874ec7e82caba562c5b4eb648c0a27798e7ec65aaa9e736b9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e353fa6a4c2d8b874ec7e82caba562c5b4eb648c0a27798e7ec65aaa9e736b9/userdata/shm major:0 minor:224 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0e3585f4f2239a98aabfed18bf2d7b14da52d2ca5d35c69f5942a6fa1ef5906d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0e3585f4f2239a98aabfed18bf2d7b14da52d2ca5d35c69f5942a6fa1ef5906d/userdata/shm major:0 minor:348 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/16e9ad9d37eb87c8286262b1d3b99a4bb3e73581d80b84fbbb6ff1aab8efbe92/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/16e9ad9d37eb87c8286262b1d3b99a4bb3e73581d80b84fbbb6ff1aab8efbe92/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/18faba9eee1b3994d28df1199f2318d3a3527836239b8143e87310c6ef7005bb/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/18faba9eee1b3994d28df1199f2318d3a3527836239b8143e87310c6ef7005bb/userdata/shm major:0 minor:215 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/35a0916c9023b47a5f2e731737289fa9d1589e02a2abae9957f134138d99f5a2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/35a0916c9023b47a5f2e731737289fa9d1589e02a2abae9957f134138d99f5a2/userdata/shm major:0 minor:295 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f/userdata/shm major:0 minor:334 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49ace7c20c5f150e398dd8c808396f7be31dc14c7748d1d92d7a7fa51b84aed5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49ace7c20c5f150e398dd8c808396f7be31dc14c7748d1d92d7a7fa51b84aed5/userdata/shm major:0 minor:346 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a6293173668a1a5e0db8bd60153e46f1b2e35d07d6e2a3fe49e729aefbea509/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a6293173668a1a5e0db8bd60153e46f1b2e35d07d6e2a3fe49e729aefbea509/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/59be6bd5e290ec4dfa564331fa0116fd109deb2fb18aa6461017c7220030fc42/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/59be6bd5e290ec4dfa564331fa0116fd109deb2fb18aa6461017c7220030fc42/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/63e1972d193346fda1c1c61d70066649bad74f78201ac3293603a369de7a5cda/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/63e1972d193346fda1c1c61d70066649bad74f78201ac3293603a369de7a5cda/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7e050394679b107b8c16de7403d2753ea8a2c794838721fa7c176aaf4cce6f2e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7e050394679b107b8c16de7403d2753ea8a2c794838721fa7c176aaf4cce6f2e/userdata/shm major:0 minor:213 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/806eed7bfa86ec6a5cd794dfe45144a056a671088cbe787f755eceb817442155/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/806eed7bfa86ec6a5cd794dfe45144a056a671088cbe787f755eceb817442155/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/84c9e2da3d4b79e1a35876572f184c4858dfff856054349ceb48405f4d71343f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/84c9e2da3d4b79e1a35876572f184c4858dfff856054349ceb48405f4d71343f/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/88b666cadc235856fefd4865702ef0ad0060320843f7f070a0393da1cb554900/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/88b666cadc235856fefd4865702ef0ad0060320843f7f070a0393da1cb554900/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8b61f222146a31a57241a90ddeaa43349548e979cf53bd5bf19cc6c8a39b21b1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8b61f222146a31a57241a90ddeaa43349548e979cf53bd5bf19cc6c8a39b21b1/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a1c83af40a9f5e2cea86fe9792495864521afc3058ffc5598a2b9657abf38d06/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a1c83af40a9f5e2cea86fe9792495864521afc3058ffc5598a2b9657abf38d06/userdata/shm major:0 minor:294 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ab8840f1225607425a4702cab46f4f57366ea2ad1436e733da4f498c36e7415a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ab8840f1225607425a4702cab46f4f57366ea2ad1436e733da4f498c36e7415a/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b9076516abfe7bd91901e50b5ca2e846092fc2c686bf21acc3795de0da60a39a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b9076516abfe7bd91901e50b5ca2e846092fc2c686bf21acc3795de0da60a39a/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c19b5a70f4bbd50938fefbef24d10a27e296e653fd871f272b0822307cdac8e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c19b5a70f4bbd50938fefbef24d10a27e296e653fd871f272b0822307cdac8e1/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/cee4bb3d06d538bda725a5230b7b159798c6988cda515f1a3908985ef5810450/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/cee4bb3d06d538bda725a5230b7b159798c6988cda515f1a3908985ef5810450/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e7919a46d7621398d20b193daad62c690427b6990d9b985b24d9e33de24a1a41/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e7919a46d7621398d20b193daad62c690427b6990d9b985b24d9e33de24a1a41/userdata/shm major:0 minor:211 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e845441bf282086133065702139b7a867fb357149fdc26366f38e53f35fbd60e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e845441bf282086133065702139b7a867fb357149fdc26366f38e53f35fbd60e/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/fbb0d9c291a6a91756503a45a0aa23121756cdef3dc7b03637eab6c0802b593d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/fbb0d9c291a6a91756503a45a0aa23121756cdef3dc7b03637eab6c0802b593d/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/feb18e0c9c2e03203b8b9fa214561d4611b043ac125325b772d3e06ec4b10a3a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/feb18e0c9c2e03203b8b9fa214561d4611b043ac125325b772d3e06ec4b10a3a/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0541c396-e42d-45e3-abe6-70b647e84341/volumes/kubernetes.io~projected/kube-api-access-fp84f:{mountpoint:/var/lib/kubelet/pods/0541c396-e42d-45e3-abe6-70b647e84341/volumes/kubernetes.io~projected/kube-api-access-fp84f major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0541c396-e42d-45e3-abe6-70b647e84341/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/0541c396-e42d-45e3-abe6-70b647e84341/volumes/kubernetes.io~secret/serving-cert major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/059455b4-e54c-4e09-9115-c264a98d5d29/volumes/kubernetes.io~projected/kube-api-access-5vprr:{mountpoint:/var/lib/kubelet/pods/059455b4-e54c-4e09-9115-c264a98d5d29/volumes/kubernetes.io~projected/kube-api-access-5vprr major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:235 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~projected/kube-api-access-tzbw4:{mountpoint:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~projected/kube-api-access-tzbw4 major:0 minor:233 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volumes/kubernetes.io~projected/kube-api-access-655qz:{mountpoint:/var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volumes/kubernetes.io~projected/kube-api-access-655qz major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1bd2844b-9872-446c-a13f-e44cf3b448f1/volumes/kubernetes.io~projected/kube-api-access-k676g:{mountpoint:/var/lib/kubelet/pods/1bd2844b-9872-446c-a13f-e44cf3b448f1/volumes/kubernetes.io~projected/kube-api-access-k676g major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5/volumes/kubernetes.io~projected/kube-api-access-7cp6q:{mountpoint:/var/lib/kubelet/pods/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5/volumes/kubernetes.io~projected/kube-api-access-7cp6q major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/302d2c96-e159-4e58-9923-ceadd49d60b5/volumes/kubernetes.io~projected/kube-api-access-z6dnv:{mountpoint:/var/lib/kubelet/pods/302d2c96-e159-4e58-9923-ceadd49d60b5/volumes/kubernetes.io~projected/kube-api-access-z6dnv major:0 minor:345 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4e4667ad-2be3-4e3c-850b-fef51ceb0513/volumes/kubernetes.io~projected/kube-api-access-rlvx8:{mountpoint:/var/lib/kubelet/pods/4e4667ad-2be3-4e3c-850b-fef51ceb0513/volumes/kubernetes.io~projected/kube-api-access-rlvx8 major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55b3ebe4-88ee-440e-9eba-e67098391841/volumes/kubernetes.io~projected/kube-api-access-dghrd:{mountpoint:/var/lib/kubelet/pods/55b3ebe4-88ee-440e-9eba-e67098391841/volumes/kubernetes.io~projected/kube-api-access-dghrd major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/616120e6-f7d2-4ca3-985d-80c1e53bc3b7/volumes/kubernetes.io~projected/kube-api-access-44lvw:{mountpoint:/var/lib/kubelet/pods/616120e6-f7d2-4ca3-985d-80c1e53bc3b7/volumes/kubernetes.io~projected/kube-api-access-44lvw major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd/volumes/kubernetes.io~projected/kube-api-access-ft74v:{mountpoint:/var/lib/kubelet/pods/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd/volumes/kubernetes.io~projected/kube-api-access-ft74v major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/618261dd-822b-486a-8cd0-40b16e371320/volumes/kubernetes.io~projected/kube-api-access-gvj6d:{mountpoint:/var/lib/kubelet/pods/618261dd-822b-486a-8cd0-40b16e371320/volumes/kubernetes.io~projected/kube-api-access-gvj6d major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/62ac74a8-8df8-48fd-8a09-9ce51991bd84/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/62ac74a8-8df8-48fd-8a09-9ce51991bd84/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6541125d-1dbc-4699-a07b-3ce05823ca0a/volumes/kubernetes.io~projected/kube-api-access-9b28h:{mountpoint:/var/lib/kubelet/pods/6541125d-1dbc-4699-a07b-3ce05823ca0a/volumes/kubernetes.io~projected/kube-api-access-9b28h major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~projected/kube-api-access-hvcwn:{mountpoint:/var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~projected/kube-api-access-hvcwn major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~secret/default-certificate major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~secret/stats-auth major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~empty-dir/tmp major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~projected/kube-api-access-84bnz:{mountpoint:/var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~projected/kube-api-access-84bnz major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/811da5af-e26c-482c-99c3-14202b7d524e/volumes/kubernetes.io~projected/kube-api-access-hzxd6:{mountpoint:/var/lib/kubelet/pods/811da5af-e26c-482c-99c3-14202b7d524e/volumes/kubernetes.io~projected/kube-api-access-hzxd6 major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/811da5af-e26c-482c-99c3-14202b7d524e/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/811da5af-e26c-482c-99c3-14202b7d524e/volumes/kubernetes.io~secret/serving-cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/852d63c2-7941-4726-8d8b-2a1aad748f1a/volumes/kubernetes.io~projected/kube-api-access-dkbn9:{mountpoint:/var/lib/kubelet/pods/852d63c2-7941-4726-8d8b-2a1aad748f1a/volumes/kubernetes.io~projected/kube-api-access-dkbn9 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8960915e-29b4-4a08-a517-c0ca433f4c95/volumes/kubernetes.io~projected/kube-api-access-qq9xh:{mountpoint:/var/lib/kubelet/pods/8960915e-29b4-4a08-a517-c0ca433f4c95/volumes/kubernetes.io~projected/kube-api-access-qq9xh major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9300cd63-4b10-4876-96a3-7130ff5d35c7/volumes/kubernetes.io~projected/kube-api-access-rbngk:{mountpoint:/var/lib/kubelet/pods/9300cd63-4b10-4876-96a3-7130ff5d35c7/volumes/kubernetes.io~projected/kube-api-access-rbngk major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98ee3610-e8cb-420a-a400-60cadd3d0d8c/volumes/kubernetes.io~projected/kube-api-access-frwrj:{mountpoint:/var/lib/kubelet/pods/98ee3610-e8cb-420a-a400-60cadd3d0d8c/volumes/kubernetes.io~projected/kube-api-access-frwrj major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f/volumes/kubernetes.io~projected/kube-api-access-m42nx:{mountpoint:/var/lib/kubelet/pods/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f/volumes/kubernetes.io~projected/kube-api-access-m42nx major:0 minor:316 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8/volumes/kubernetes.io~projected/kube-api-access-sxjb9:{mountpoint:/var/lib/kubelet/pods/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8/volumes/kubernetes.io~projected/kube-api-access-sxjb9 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/bb1c6275-037e-44d2-89c0-8bb80d832a11/volumes/kubernetes.io~projected/kube-api-access-jqnxf:{mountpoint:/var/lib/kubelet/pods/bb1c6275-037e-44d2-89c0-8bb80d832a11/volumes/kubernetes.io~projected/kube-api-access-jqnxf major:0 minor:293 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c3eeb01d-abf0-404d-bae0-5810acc09628/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/c3eeb01d-abf0-404d-bae0-5810acc09628/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c76f66cb-43f9-4ce9-8ce4-04f241205199/volumes/kubernetes.io~projected/kube-api-access-7j57c:{mountpoint:/var/lib/kubelet/pods/c76f66cb-43f9-4ce9-8ce4-04f241205199/volumes/kubernetes.io~projected/kube-api-access-7j57c major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c76f66cb-43f9-4ce9-8ce4-04f241205199/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/c76f66cb-43f9-4ce9-8ce4-04f241205199/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cbebc1f6-9c14-406d-a918-f6857cc5b2cf/volumes/kubernetes.io~projected/kube-api-access-rkk8q:{mountpoint:/var/lib/kubelet/pods/cbebc1f6-9c14-406d-a918-f6857cc5b2cf/volumes/kubernetes.io~projected/kube-api-access-rkk8q major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d13c24d6-6885-4eb9-952c-1c366b8d775b/volumes/kubernetes.io~projected/kube-api-access-r9gnm:{mountpoint:/var/lib/kubelet/pods/d13c24d6-6885-4eb9-952c-1c366b8d775b/volumes/kubernetes.io~projected/kube-api-access-r9gnm major:0 minor:236 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d13c24d6-6885-4eb9-952c-1c366b8d775b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/d13c24d6-6885-4eb9-952c-1c366b8d775b/volumes/kubernetes.io~secret/serving-cert major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc/volumes/kubernetes.io~projected/kube-api-access-cvslz:{mountpoint:/var/lib/kubelet/pods/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc/volumes/kubernetes.io~projected/kube-api-access-cvslz major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e91996ad-4da7-45d6-89af-c384db0d8211/volumes/kubernetes.io~projected/kube-api-access-h92vn:{mountpoint:/var/lib/kubelet/pods/e91996ad-4da7-45d6-89af-c384db0d8211/volumes/kubernetes.io~projected/kube-api-access-h92vn major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~projected/kube-api-access-46n9z:{mountpoint:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~projected/kube-api-access-46n9z major:0 minor:237 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff8d2adc-7480-498a-8038-686b9efa537a/volumes/kubernetes.io~projected/kube-api-access-k45w4:{mountpoint:/var/lib/kubelet/pods/ff8d2adc-7480-498a-8038-686b9efa537a/volumes/kubernetes.io~projected/kube-api-access-k45w4 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ff8d2adc-7480-498a-8038-686b9efa537a/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/ff8d2adc-7480-498a-8038-686b9efa537a/volumes/kubernetes.io~secret/cert major:0 minor:218 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/7cc34cff4d915ec4a17cea40e629e06d86c5b08bf5c9b56bea9a33fc44ac59b5/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/e97571ce504a8de03e5900f70117a20757042b7870a8a85adae92dd4e71c5ae6/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/462c3ec5529f25124229ce73f2f8d7819dce5d1ef912f7634008733d8634c92d/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-110:{mountpoint:/var/lib/containers/storage/overlay/4efb76bd96d63016a6b6d496304f618039df51503eb9c1a8338afd3946ddee9d/merged major:0 minor:110 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/b91abc0d277e7cca61d67fde0914d645f79c8657d39c73315104f4aad9808004/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/ad766f33c247606bca780b1375d8f1adb02147e0e16b2b05a8419b9898413729/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/eecad969b4b286b8bcc1d050d49f08520df1b3f49ea65b625a6d7ab4d1e0e50f/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/8b1a01ec09d84aaa3ff68e51d14e450f6d933216ad137e1064f532f21ec9433d/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/538f2c07d7088b05009c5754f8e058eb5a3f54983aa792598bc9d3f2f847a2ec/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/95e69c23bad0c86efa0a500ad8973a5ff903b19d24c145476ef92dfc514e43f5/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/200148d96929fe56cc24b2f25a8a62408024d1673008d751fd18bc1ede4f2018/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/4b99636a1818145d102db64c79cb3eb1a9a212142b04ac310aefaf945b96f047/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/f809cf053c511c84c12bf821c09daa42b659cfb0fc3a4ff4f8276f5b1ec3f0f5/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/4a6cf805ab2ef6006d78c32fed385f50bf7c2c04a3658ad580bd7ba1cc191106/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/0ce15cb58ed7fdc9ba20d131e525b193869306597d9037c7f118aa75dbb70406/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/a46cc8a92692de2a2ec523c9bc6fcca25b70d5b363630e7121450755720ff68a/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/d4e798a29c1dc55357eee657297fe485e440d4d8280b06e38b5bcc566e2b8049/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/21ae89498f4464f4db92e5da912c24f3ba5d1bfd7c66179e9430dfffee17e9f8/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/5b152219830d3df5b7ff6f38bad45efdf912540a3a4b88718e78fa47e07cca29/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/7e8c4c0e9c7f4a467432dbb9f00cb731da8696df3616adba938e17825f816011/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/55317638c4065765515b13803e221759d7f6381f93a409eb47192cc346ef90a6/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/cf7cc47407b769a57cbfbccda42517f2c96d70f2a37b657fd95015df22c8f7b8/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/5a8b38eef5903b023b0a2f51cf71f330d2efd0ad8dd88c4c21f443bc429be9da/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/5bba4c9ff2c48db388d8f44c352e4a4b77c6be19232eba7957155f5cbfb918e5/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/197a297c1c523157e0220c146ed2fc4de7035f36a07d7227704ddbf5ab9f067f/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/423911558e1a94c645a557d98981233ef7c94b1eab9240338a654410fe7f855d/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/def0dfc3f456321e6be504f7107727ed0403027bb16ad389c7076f30aed01990/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/0d8edfd7fb0b451f017f4bb84d25233c106256d58f71254792f8c7088f397df2/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/1b92fdb1731d01c700baf027871cc2bc2f61f8643b989219723c377529de4785/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/706ee8888d53dd551fc1841d2634d8ee4e3d2fb2193fc85c68d2be420d37e0c8/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/231a898e0c992b73f1739cfa339d2a086fa8423185c7305d38602d49b0de776b/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/180303d8e5f501bc1f8b02d61c40c93e3be7345e597d657e34b46926a7d05054/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-278:{mountpoint:/var/lib/containers/storage/overlay/e3fe4307fa131675859cb31347100e11355f18bd76b97e68d833fe5fa87b821e/merged major:0 minor:278 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/e9c1a7e2d9f9666d206f0c54790e40832b96a0bdd5662aaf3d23dbff84221829/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/7c913ae76b92a3cd7dcdd7737e4c408bc63dc90bde12b65c419c8944a80036da/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/e1bb87b2ceb2376742f3edac8395f6e082fe14caf2ccf84d015eec9748209b5c/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/27d5d5475bddb3ecaa2d81fa35ddd4ae96aa8b4d0f12d2a8000e9f1539609272/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/21f6a47cfb8c1f9902f44746305872cc46eb4e0598eb411e49effc895287e831/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/aa693725061afea45755a2bedc6395b8b397853c1e0646c79ccc2d95314f4c90/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/e4c978aa031f8d67a058828dd8259947dd85777c0b9cfdc68a7da8a35e2999f6/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-312:{mountpoint:/var/lib/containers/storage/overlay/55c5cf84bebfc0b9dba26fd23a1031c8adca44bbbbf9b6fc952383897a6dafc8/merged major:0 minor:312 fsType:overlay blockSize:0} overlay_0-314:{mountpoint:/var/lib/containers/storage/overlay/b2e5895322b2d1fdd5faac39e352af18c4dd0a446cb49ddd9c206d635a5747e2/merged major:0 minor:314 fsType:overlay blockSize:0} overlay_0-336:{mountpoint:/var/lib/containers/storage/overlay/87b11f1f1cc58de498c7f95e72a57d812d27e1f111d88a8d9eaa0e2aaf99c64c/merged major:0 minor:336 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/a6c6f1a232a2137219a2a21b2a5de0308d610ac87dd6530c93341689aa8d7f17/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/adfab8a2c08cd2d353ea9f0d1ae992eb098027258f07700a182ca103ec4d978c/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/0623c04af67b995f942622f3e35200f45a43f5324236d82de4b5fbf7147257d1/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/3001dbb8c62d7f8aa60f764a852d8c5f11d20e95414ba83c62be119f08f85994/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/f1a81ed4255e78db5cba0afd4b7f9f68638abcf1d0f8c5be57233a1519e49318/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/feb9bab9e0e788026f4bd175e730ddbe5e846006396f2e170323538b750ebd83/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-373:{mountpoint:/var/lib/containers/storage/overlay/f90f2dc95cca806d154a7bd7a67309e981f35239ce51faaf2c95216c76ab3f92/merged major:0 minor:373 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/cdd68638003e3d66c7d197a7b25ef97c65ed2f98bc341511f85c32ef9cbfe03a/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/d1e11186d5e7451ad511fd557efec6856b6ce708b2df4ae10b3699c8053c33c2/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/c74fe0599552672db8e0f4bb0809b736dae94de8260566a91ac50761b2cb1e1a/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/9111395ff7f25678b88ecc916e0635af956b4c8cf6e6e163cc5af6b648ab0e90/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/055757b673397368f436ce69e63961e07d9d025742ccd9c16947a1c85815a8f4/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/712d1c25665c7b0946f443fc48e4a034c1dad3cba7597f78ec46c11b40e8c83c/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/64bb022eaf85a90993edae8bdf96243000fe6a7070cf4659b5deab6ccf114653/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/cfb58e5259c991bf1981325262d87c0566d906f55f17ec5e3d4a4e780c59a5c7/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/a0f8c317c744be29c4ba261df4b5666dbc18d54d724a3bd2794530df4969446e/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/256d926e0e028761b0da60ece2bbe44c34599531606eec5b8638143073fad04b/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 03 19:50:52.277500 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.277160 5024 manager.go:217] Machine: {Timestamp:2026-11-03 19:50:52.276699803 +0000 UTC m=+0.058416461 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3179819 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec247f86d6a65fb33dad3566ea56af4a SystemUUID:ec247f86-d6a6-5fb3-3dad-3566ea56af4a BootID:6891a63d-f596-472c-9949-cbc83eb27645 Filesystems:[{Device:/var/lib/kubelet/pods/d13c24d6-6885-4eb9-952c-1c366b8d775b/volumes/kubernetes.io~projected/kube-api-access-r9gnm DeviceMajor:0 DeviceMinor:236 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f/volumes/kubernetes.io~projected/kube-api-access-m42nx DeviceMajor:0 DeviceMinor:316 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/cbebc1f6-9c14-406d-a918-f6857cc5b2cf/volumes/kubernetes.io~projected/kube-api-access-rkk8q DeviceMajor:0 DeviceMinor:232 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a6293173668a1a5e0db8bd60153e46f1b2e35d07d6e2a3fe49e729aefbea509/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-110 DeviceMajor:0 DeviceMinor:110 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7e050394679b107b8c16de7403d2753ea8a2c794838721fa7c176aaf4cce6f2e/userdata/shm DeviceMajor:0 DeviceMinor:213 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:221 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/811da5af-e26c-482c-99c3-14202b7d524e/volumes/kubernetes.io~projected/kube-api-access-hzxd6 DeviceMajor:0 DeviceMinor:206 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/806eed7bfa86ec6a5cd794dfe45144a056a671088cbe787f755eceb817442155/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-314 DeviceMajor:0 DeviceMinor:314 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e91996ad-4da7-45d6-89af-c384db0d8211/volumes/kubernetes.io~projected/kube-api-access-h92vn DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8/volumes/kubernetes.io~projected/kube-api-access-sxjb9 DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/88b666cadc235856fefd4865702ef0ad0060320843f7f070a0393da1cb554900/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:60 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9300cd63-4b10-4876-96a3-7130ff5d35c7/volumes/kubernetes.io~projected/kube-api-access-rbngk DeviceMajor:0 DeviceMinor:204 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:235 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e3585f4f2239a98aabfed18bf2d7b14da52d2ca5d35c69f5942a6fa1ef5906d/userdata/shm DeviceMajor:0 DeviceMinor:348 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/16e9ad9d37eb87c8286262b1d3b99a4bb3e73581d80b84fbbb6ff1aab8efbe92/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd/volumes/kubernetes.io~projected/kube-api-access-ft74v DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-312 DeviceMajor:0 DeviceMinor:312 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-336 DeviceMajor:0 DeviceMinor:336 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-373 DeviceMajor:0 DeviceMinor:373 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/63e1972d193346fda1c1c61d70066649bad74f78201ac3293603a369de7a5cda/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/feb18e0c9c2e03203b8b9fa214561d4611b043ac125325b772d3e06ec4b10a3a/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~projected/kube-api-access-hvcwn DeviceMajor:0 DeviceMinor:203 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/618261dd-822b-486a-8cd0-40b16e371320/volumes/kubernetes.io~projected/kube-api-access-gvj6d DeviceMajor:0 DeviceMinor:208 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ab8840f1225607425a4702cab46f4f57366ea2ad1436e733da4f498c36e7415a/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c76f66cb-43f9-4ce9-8ce4-04f241205199/volumes/kubernetes.io~projected/kube-api-access-7j57c DeviceMajor:0 DeviceMinor:205 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0541c396-e42d-45e3-abe6-70b647e84341/volumes/kubernetes.io~projected/kube-api-access-fp84f DeviceMajor:0 DeviceMinor:231 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/62ac74a8-8df8-48fd-8a09-9ce51991bd84/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/bb1c6275-037e-44d2-89c0-8bb80d832a11/volumes/kubernetes.io~projected/kube-api-access-jqnxf DeviceMajor:0 DeviceMinor:293 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:62 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e845441bf282086133065702139b7a867fb357149fdc26366f38e53f35fbd60e/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:229 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/fbb0d9c291a6a91756503a45a0aa23121756cdef3dc7b03637eab6c0802b593d/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e7919a46d7621398d20b193daad62c690427b6990d9b985b24d9e33de24a1a41/userdata/shm DeviceMajor:0 DeviceMinor:211 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4e4667ad-2be3-4e3c-850b-fef51ceb0513/volumes/kubernetes.io~projected/kube-api-access-rlvx8 DeviceMajor:0 DeviceMinor:227 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/35a0916c9023b47a5f2e731737289fa9d1589e02a2abae9957f134138d99f5a2/userdata/shm DeviceMajor:0 DeviceMinor:295 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:61 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/811da5af-e26c-482c-99c3-14202b7d524e/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/616120e6-f7d2-4ca3-985d-80c1e53bc3b7/volumes/kubernetes.io~projected/kube-api-access-44lvw DeviceMajor:0 DeviceMinor:207 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0541c396-e42d-45e3-abe6-70b647e84341/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:219 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c3eeb01d-abf0-404d-bae0-5810acc09628/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5/volumes/kubernetes.io~projected/kube-api-access-7cp6q DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/cee4bb3d06d538bda725a5230b7b159798c6988cda515f1a3908985ef5810450/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc/volumes/kubernetes.io~projected/kube-api-access-cvslz DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/6541125d-1dbc-4699-a07b-3ce05823ca0a/volumes/kubernetes.io~projected/kube-api-access-9b28h DeviceMajor:0 DeviceMinor:340 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volumes/kubernetes.io~projected/kube-api-access-655qz DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d13c24d6-6885-4eb9-952c-1c366b8d775b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:220 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/852d63c2-7941-4726-8d8b-2a1aad748f1a/volumes/kubernetes.io~projected/kube-api-access-dkbn9 DeviceMajor:0 DeviceMinor:333 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/55b3ebe4-88ee-440e-9eba-e67098391841/volumes/kubernetes.io~projected/kube-api-access-dghrd DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/18faba9eee1b3994d28df1199f2318d3a3527836239b8143e87310c6ef7005bb/userdata/shm DeviceMajor:0 DeviceMinor:215 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/059455b4-e54c-4e09-9115-c264a98d5d29/volumes/kubernetes.io~projected/kube-api-access-5vprr DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9/volumes/kubernetes.io~projected/kube-api-access-84bnz DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1bd2844b-9872-446c-a13f-e44cf3b448f1/volumes/kubernetes.io~projected/kube-api-access-k676g DeviceMajor:0 DeviceMinor:234 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ff8d2adc-7480-498a-8038-686b9efa537a/volumes/kubernetes.io~projected/kube-api-access-k45w4 DeviceMajor:0 DeviceMinor:226 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~projected/kube-api-access-46n9z DeviceMajor:0 DeviceMinor:237 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/59be6bd5e290ec4dfa564331fa0116fd109deb2fb18aa6461017c7220030fc42/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ff8d2adc-7480-498a-8038-686b9efa537a/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:218 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~projected/kube-api-access-tzbw4 DeviceMajor:0 DeviceMinor:233 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/302d2c96-e159-4e58-9923-ceadd49d60b5/volumes/kubernetes.io~projected/kube-api-access-z6dnv DeviceMajor:0 DeviceMinor:345 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f/userdata/shm DeviceMajor:0 DeviceMinor:334 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c19b5a70f4bbd50938fefbef24d10a27e296e653fd871f272b0822307cdac8e1/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/84c9e2da3d4b79e1a35876572f184c4858dfff856054349ceb48405f4d71343f/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-278 DeviceMajor:0 DeviceMinor:278 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0e353fa6a4c2d8b874ec7e82caba562c5b4eb648c0a27798e7ec65aaa9e736b9/userdata/shm DeviceMajor:0 DeviceMinor:224 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/98ee3610-e8cb-420a-a400-60cadd3d0d8c/volumes/kubernetes.io~projected/kube-api-access-frwrj DeviceMajor:0 DeviceMinor:230 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a1c83af40a9f5e2cea86fe9792495864521afc3058ffc5598a2b9657abf38d06/userdata/shm DeviceMajor:0 DeviceMinor:294 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:217 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:222 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:223 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49ace7c20c5f150e398dd8c808396f7be31dc14c7748d1d92d7a7fa51b84aed5/userdata/shm DeviceMajor:0 DeviceMinor:346 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b9076516abfe7bd91901e50b5ca2e846092fc2c686bf21acc3795de0da60a39a/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8b61f222146a31a57241a90ddeaa43349548e979cf53bd5bf19cc6c8a39b21b1/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c76f66cb-43f9-4ce9-8ce4-04f241205199/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8960915e-29b4-4a08-a517-c0ca433f4c95/volumes/kubernetes.io~projected/kube-api-access-qq9xh DeviceMajor:0 DeviceMinor:228 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b517d3a-c283-4a81-a5ee-bd217d966bce/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0e353fa6a4c2d8b MacAddress:2a:96:ff:8f:07:06 Speed:10000 Mtu:8901} {Name:0e3585f4f2239a9 MacAddress:fe:4f:62:d2:18:66 Speed:10000 Mtu:8901} {Name:18faba9eee1b399 MacAddress:8a:84:80:53:16:30 Speed:10000 Mtu:8901} {Name:35a0916c9023b47 MacAddress:9a:b1:2a:0c:f7:b9 Speed:10000 Mtu:8901} {Name:471f89cb5035fd0 MacAddress:f2:4b:b4:71:89:d3 Speed:10000 Mtu:8901} {Name:49ace7c20c5f150 MacAddress:4a:a2:81:62:ad:98 Speed:10000 Mtu:8901} {Name:63e1972d193346f MacAddress:6a:76:cd:15:19:03 Speed:10000 Mtu:8901} {Name:7e050394679b107 MacAddress:2e:4b:d6:c1:f5:aa Speed:10000 Mtu:8901} {Name:806eed7bfa86ec6 MacAddress:72:ba:50:3e:6a:08 Speed:10000 Mtu:8901} {Name:a1c83af40a9f5e2 MacAddress:9e:a5:a1:79:20:48 Speed:10000 Mtu:8901} {Name:ab8840f12256074 MacAddress:22:e1:6a:00:62:84 Speed:10000 Mtu:8901} {Name:b9076516abfe7bd MacAddress:fa:42:85:56:fd:a6 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:71:6a:1a:c9:ef Speed:0 Mtu:9001} {Name:br-int MacAddress:82:4d:90:e4:10:59 Speed:0 Mtu:8901} {Name:cee4bb3d06d538b MacAddress:a6:57:a4:29:b5:cc Speed:10000 Mtu:8901} {Name:e7919a46d762139 MacAddress:3a:3c:a6:8d:d3:bb Speed:10000 Mtu:8901} {Name:e845441bf282086 MacAddress:e6:90:a3:fd:41:01 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:71:6a:1a:c9:ef Speed:0 Mtu:9001} {Name:genev_sys_6081 MacAddress:62:04:fa:3b:d3:bd Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:32:5e:31:5e:1c:41 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 03 19:50:52.277701 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.277505 5024 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 03 19:50:52.277701 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.277617 5024 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 03 19:50:52.277951 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.277905 5024 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 03 19:50:52.278085 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.277941 5024 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-64.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 03 19:50:52.278129 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278088 5024 topology_manager.go:143] "Creating topology manager with none policy" Nov 03 19:50:52.278129 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278096 5024 container_manager_linux.go:311] "Creating device plugin manager" Nov 03 19:50:52.278129 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278106 5024 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:52.278210 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278130 5024 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 03 19:50:52.278240 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278228 5024 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 03 19:50:52.278392 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278383 5024 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 03 19:50:52.278513 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278504 5024 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 03 19:50:52.278550 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278543 5024 kubelet.go:493] "Attempting to sync node with API server" Nov 03 19:50:52.278586 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278554 5024 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 03 19:50:52.278586 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278565 5024 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 03 19:50:52.278586 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278577 5024 kubelet.go:405] "Adding apiserver pod source" Nov 03 19:50:52.278586 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.278584 5024 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 03 19:50:52.279464 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.279448 5024 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 19:50:52.279464 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.279461 5024 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:52.279987 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.279970 5024 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 03 19:50:52.282706 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.282691 5024 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 03 19:50:52.282706 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.282704 5024 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 03 19:50:52.282810 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.282800 5024 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 03 19:50:52.283020 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283008 5024 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 03 19:50:52.283051 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283038 5024 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 03 19:50:52.283155 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283146 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 03 19:50:52.283189 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283161 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 03 19:50:52.283189 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283167 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 03 19:50:52.283189 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283172 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 03 19:50:52.283189 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283180 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 03 19:50:52.283189 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283188 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283197 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283203 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283209 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283215 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283223 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283233 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283260 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 03 19:50:52.283310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.283268 5024 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 03 19:50:52.286744 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.286731 5024 server.go:1263] "Started kubelet" Nov 03 19:50:52.286882 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.286818 5024 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 03 19:50:52.287597 ip-10-0-131-64 systemd[1]: Started Kubernetes Kubelet. Nov 03 19:50:52.287966 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.287684 5024 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 03 19:50:52.287966 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.287953 5024 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 03 19:50:52.290105 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.288357 5024 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 03 19:50:52.290105 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.289569 5024 server.go:317] "Adding debug handlers to kubelet server" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.294108 5024 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.294126 5024 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.294176 5024 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-02 19:45:13 +0000 UTC" deadline="2028-04-20 21:21:53.824265109 +0000 UTC" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.294196 5024 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12817h31m1.530072607s" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.294250 5024 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.294258 5024 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.294311 5024 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:52.295193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.294351 5024 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 03 19:50:52.295985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.295703 5024 factory.go:153] Registering CRI-O factory Nov 03 19:50:52.295985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.295723 5024 factory.go:223] Registration of the crio container factory successfully Nov 03 19:50:52.295985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.295796 5024 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 03 19:50:52.295985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.295807 5024 factory.go:55] Registering systemd factory Nov 03 19:50:52.295985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.295815 5024 factory.go:223] Registration of the systemd container factory successfully Nov 03 19:50:52.295985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.295831 5024 factory.go:103] Registering Raw factory Nov 03 19:50:52.295985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.295863 5024 manager.go:1199] Started watching for new ooms in manager Nov 03 19:50:52.296956 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.296343 5024 manager.go:319] Starting recovery of all containers Nov 03 19:50:52.297488 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297456 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="852d63c2-7941-4726-8d8b-2a1aad748f1a" volumeName="kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle" seLinuxMountContext="" Nov 03 19:50:52.297560 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297493 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98ee3610-e8cb-420a-a400-60cadd3d0d8c" volumeName="kubernetes.io/projected/98ee3610-e8cb-420a-a400-60cadd3d0d8c-kube-api-access-frwrj" seLinuxMountContext="" Nov 03 19:50:52.297560 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297508 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b7095bf3-9ab1-47b1-a14e-aeda90c64cd8" volumeName="kubernetes.io/projected/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-kube-api-access-sxjb9" seLinuxMountContext="" Nov 03 19:50:52.297560 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297531 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d13c24d6-6885-4eb9-952c-1c366b8d775b" volumeName="kubernetes.io/configmap/d13c24d6-6885-4eb9-952c-1c366b8d775b-config" seLinuxMountContext="" Nov 03 19:50:52.297659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297562 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc" volumeName="kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cni-binary-copy" seLinuxMountContext="" Nov 03 19:50:52.297659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297572 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff8d2adc-7480-498a-8038-686b9efa537a" volumeName="kubernetes.io/secret/ff8d2adc-7480-498a-8038-686b9efa537a-cert" seLinuxMountContext="" Nov 03 19:50:52.297659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297592 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" volumeName="kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates" seLinuxMountContext="" Nov 03 19:50:52.297659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297604 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" volumeName="kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted" seLinuxMountContext="" Nov 03 19:50:52.297659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297618 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="618261dd-822b-486a-8cd0-40b16e371320" volumeName="kubernetes.io/projected/618261dd-822b-486a-8cd0-40b16e371320-kube-api-access-gvj6d" seLinuxMountContext="" Nov 03 19:50:52.297659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297640 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c76f66cb-43f9-4ce9-8ce4-04f241205199" volumeName="kubernetes.io/projected/c76f66cb-43f9-4ce9-8ce4-04f241205199-kube-api-access-7j57c" seLinuxMountContext="" Nov 03 19:50:52.297659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297652 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e91996ad-4da7-45d6-89af-c384db0d8211" volumeName="kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297665 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="059455b4-e54c-4e09-9115-c264a98d5d29" volumeName="kubernetes.io/projected/059455b4-e54c-4e09-9115-c264a98d5d29-kube-api-access-5vprr" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297690 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55b3ebe4-88ee-440e-9eba-e67098391841" volumeName="kubernetes.io/configmap/55b3ebe4-88ee-440e-9eba-e67098391841-serviceca" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297700 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb450369-6fdb-4f91-82ac-e6ea5b974551" volumeName="kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297713 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0541c396-e42d-45e3-abe6-70b647e84341" volumeName="kubernetes.io/configmap/0541c396-e42d-45e3-abe6-70b647e84341-config" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297734 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f" volumeName="kubernetes.io/projected/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-api-access-m42nx" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297744 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c76f66cb-43f9-4ce9-8ce4-04f241205199" volumeName="kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-trusted-ca" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297754 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9" volumeName="kubernetes.io/projected/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-kube-api-access-84bnz" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297764 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9300cd63-4b10-4876-96a3-7130ff5d35c7" volumeName="kubernetes.io/projected/9300cd63-4b10-4876-96a3-7130ff5d35c7-kube-api-access-rbngk" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297778 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ff8d2adc-7480-498a-8038-686b9efa537a" volumeName="kubernetes.io/projected/ff8d2adc-7480-498a-8038-686b9efa537a-kube-api-access-k45w4" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297791 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1687e9c0-54ea-45aa-accd-ebfcf8cc9efa" volumeName="kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-script-lib" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297805 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55b3ebe4-88ee-440e-9eba-e67098391841" volumeName="kubernetes.io/projected/55b3ebe4-88ee-440e-9eba-e67098391841-kube-api-access-dghrd" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297818 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9" volumeName="kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-tuned" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297830 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="811da5af-e26c-482c-99c3-14202b7d524e" volumeName="kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-service-ca-bundle" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297842 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8960915e-29b4-4a08-a517-c0ca433f4c95" volumeName="kubernetes.io/projected/8960915e-29b4-4a08-a517-c0ca433f4c95-kube-api-access-qq9xh" seLinuxMountContext="" Nov 03 19:50:52.297862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297855 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="bb1c6275-037e-44d2-89c0-8bb80d832a11" volumeName="kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297868 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2df91d19-7cca-4ca4-b47a-f1246e6c5ee5" volumeName="kubernetes.io/projected/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kube-api-access-7cp6q" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297887 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e4667ad-2be3-4e3c-850b-fef51ceb0513" volumeName="kubernetes.io/configmap/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-config" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297904 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="811da5af-e26c-482c-99c3-14202b7d524e" volumeName="kubernetes.io/projected/811da5af-e26c-482c-99c3-14202b7d524e-kube-api-access-hzxd6" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297916 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c76f66cb-43f9-4ce9-8ce4-04f241205199" volumeName="kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-config" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297959 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc" volumeName="kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-daemon-config" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297972 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb450369-6fdb-4f91-82ac-e6ea5b974551" volumeName="kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.297997 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb450369-6fdb-4f91-82ac-e6ea5b974551" volumeName="kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298020 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0541c396-e42d-45e3-abe6-70b647e84341" volumeName="kubernetes.io/projected/0541c396-e42d-45e3-abe6-70b647e84341-kube-api-access-fp84f" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298032 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1687e9c0-54ea-45aa-accd-ebfcf8cc9efa" volumeName="kubernetes.io/projected/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-kube-api-access-655qz" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298045 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="811da5af-e26c-482c-99c3-14202b7d524e" volumeName="kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-snapshots" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298069 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="811da5af-e26c-482c-99c3-14202b7d524e" volumeName="kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-tmp" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298082 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="852d63c2-7941-4726-8d8b-2a1aad748f1a" volumeName="kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298108 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3eeb01d-abf0-404d-bae0-5810acc09628" volumeName="kubernetes.io/secret/c3eeb01d-abf0-404d-bae0-5810acc09628-agent-certs" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298130 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ef723529-7fa2-42f5-bee1-cd5a24780a78" volumeName="kubernetes.io/configmap/ef723529-7fa2-42f5-bee1-cd5a24780a78-nginx-conf" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298144 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="059455b4-e54c-4e09-9115-c264a98d5d29" volumeName="kubernetes.io/empty-dir/059455b4-e54c-4e09-9115-c264a98d5d29-tmp-dir" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298156 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1687e9c0-54ea-45aa-accd-ebfcf8cc9efa" volumeName="kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-config" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298179 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b517d3a-c283-4a81-a5ee-bd217d966bce" volumeName="kubernetes.io/projected/6b517d3a-c283-4a81-a5ee-bd217d966bce-kube-api-access-hvcwn" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298191 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="811da5af-e26c-482c-99c3-14202b7d524e" volumeName="kubernetes.io/secret/811da5af-e26c-482c-99c3-14202b7d524e-serving-cert" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298203 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cbebc1f6-9c14-406d-a918-f6857cc5b2cf" volumeName="kubernetes.io/projected/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-kube-api-access-rkk8q" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298216 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="62ac74a8-8df8-48fd-8a09-9ce51991bd84" volumeName="kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298240 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b517d3a-c283-4a81-a5ee-bd217d966bce" volumeName="kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-stats-auth" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298252 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f" volumeName="kubernetes.io/empty-dir/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-data-volume" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298274 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c76f66cb-43f9-4ce9-8ce4-04f241205199" volumeName="kubernetes.io/secret/c76f66cb-43f9-4ce9-8ce4-04f241205199-serving-cert" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298286 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cbebc1f6-9c14-406d-a918-f6857cc5b2cf" volumeName="kubernetes.io/configmap/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-telemetry-config" seLinuxMountContext="" Nov 03 19:50:52.298302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298299 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb450369-6fdb-4f91-82ac-e6ea5b974551" volumeName="kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298312 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" volumeName="kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298327 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1687e9c0-54ea-45aa-accd-ebfcf8cc9efa" volumeName="kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-env-overrides" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298339 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e4667ad-2be3-4e3c-850b-fef51ceb0513" volumeName="kubernetes.io/projected/4e4667ad-2be3-4e3c-850b-fef51ceb0513-kube-api-access-rlvx8" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298362 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="616120e6-f7d2-4ca3-985d-80c1e53bc3b7" volumeName="kubernetes.io/projected/616120e6-f7d2-4ca3-985d-80c1e53bc3b7-kube-api-access-44lvw" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298375 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="616c46b6-a9fb-4a1c-b10d-b6d623f97ddd" volumeName="kubernetes.io/configmap/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-iptables-alerter-script" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298396 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6541125d-1dbc-4699-a07b-3ce05823ca0a" volumeName="kubernetes.io/projected/6541125d-1dbc-4699-a07b-3ce05823ca0a-kube-api-access-9b28h" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298409 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c3eeb01d-abf0-404d-bae0-5810acc09628" volumeName="kubernetes.io/configmap/c3eeb01d-abf0-404d-bae0-5810acc09628-konnectivity-ca" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298423 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d13c24d6-6885-4eb9-952c-1c366b8d775b" volumeName="kubernetes.io/projected/d13c24d6-6885-4eb9-952c-1c366b8d775b-kube-api-access-r9gnm" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298457 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0541c396-e42d-45e3-abe6-70b647e84341" volumeName="kubernetes.io/secret/0541c396-e42d-45e3-abe6-70b647e84341-serving-cert" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298471 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" volumeName="kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298483 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" volumeName="kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298505 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" volumeName="kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298519 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="616c46b6-a9fb-4a1c-b10d-b6d623f97ddd" volumeName="kubernetes.io/projected/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-kube-api-access-ft74v" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298531 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e91996ad-4da7-45d6-89af-c384db0d8211" volumeName="kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-binary-copy" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298543 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e91996ad-4da7-45d6-89af-c384db0d8211" volumeName="kubernetes.io/projected/e91996ad-4da7-45d6-89af-c384db0d8211-kube-api-access-h92vn" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298554 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" volumeName="kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298567 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1687e9c0-54ea-45aa-accd-ebfcf8cc9efa" volumeName="kubernetes.io/secret/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovn-node-metrics-cert" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298579 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b517d3a-c283-4a81-a5ee-bd217d966bce" volumeName="kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-default-certificate" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298592 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="852d63c2-7941-4726-8d8b-2a1aad748f1a" volumeName="kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298605 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="852d63c2-7941-4726-8d8b-2a1aad748f1a" volumeName="kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298616 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d13c24d6-6885-4eb9-952c-1c366b8d775b" volumeName="kubernetes.io/secret/d13c24d6-6885-4eb9-952c-1c366b8d775b-serving-cert" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298628 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9" volumeName="kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-tmp" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298640 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="811da5af-e26c-482c-99c3-14202b7d524e" volumeName="kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-trusted-ca-bundle" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298651 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8960915e-29b4-4a08-a517-c0ca433f4c95" volumeName="kubernetes.io/empty-dir/8960915e-29b4-4a08-a517-c0ca433f4c95-tmp-dir" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298665 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc" volumeName="kubernetes.io/projected/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-kube-api-access-cvslz" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298677 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e91996ad-4da7-45d6-89af-c384db0d8211" volumeName="kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-sysctl-allowlist" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298691 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb450369-6fdb-4f91-82ac-e6ea5b974551" volumeName="kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298704 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1bd2844b-9872-446c-a13f-e44cf3b448f1" volumeName="kubernetes.io/projected/1bd2844b-9872-446c-a13f-e44cf3b448f1-kube-api-access-k676g" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298716 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="302d2c96-e159-4e58-9923-ceadd49d60b5" volumeName="kubernetes.io/projected/302d2c96-e159-4e58-9923-ceadd49d60b5-kube-api-access-z6dnv" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298727 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8960915e-29b4-4a08-a517-c0ca433f4c95" volumeName="kubernetes.io/configmap/8960915e-29b4-4a08-a517-c0ca433f4c95-config-volume" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298740 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb450369-6fdb-4f91-82ac-e6ea5b974551" volumeName="kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298753 5024 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="eb450369-6fdb-4f91-82ac-e6ea5b974551" volumeName="kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z" seLinuxMountContext="" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298766 5024 reconstruct.go:97] "Volume reconstruction finished" Nov 03 19:50:52.298998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.298775 5024 reconciler.go:29] "Reconciler: start to sync state" Nov 03 19:50:52.317896 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.317871 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/1.log" Nov 03 19:50:52.318041 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.317981 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/1.log" Nov 03 19:50:52.323514 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.323495 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:52.323709 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.323694 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:52.326032 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.326003 5024 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 03 19:50:52.327458 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.327435 5024 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 03 19:50:52.327458 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.327460 5024 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 03 19:50:52.327586 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.327482 5024 kubelet.go:2521] "Starting kubelet main sync loop" Nov 03 19:50:52.327586 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.327518 5024 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 03 19:50:52.347759 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.347740 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/1.log" Nov 03 19:50:52.347873 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.347767 5024 generic.go:356] "Generic (PLEG): container finished" podID="c76f66cb-43f9-4ce9-8ce4-04f241205199" containerID="fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b" exitCode=255 Nov 03 19:50:52.351605 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.351582 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:50:52.351902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.351877 5024 generic.go:356] "Generic (PLEG): container finished" podID="1687e9c0-54ea-45aa-accd-ebfcf8cc9efa" containerID="46ad0d4c66927dfa721d209fb58f88967da952d7267e7d8c0b14b63d689b6ce8" exitCode=1 Nov 03 19:50:52.361705 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.361682 5024 generic.go:356] "Generic (PLEG): container finished" podID="095256848cfdd23f0d4ac6f78af21242" containerID="6dd8a6f875be91879594c19d11491694c5678017a3f11a568ff892b0e78b98b4" exitCode=0 Nov 03 19:50:52.373548 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.373528 5024 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="0979a6229307417240b092fba10858b7fe60ff1646eb3c99dbb06516ab861310" exitCode=0 Nov 03 19:50:52.373548 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.373547 5024 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="2582867b261c6c4789645a3ffd4dd357a05c3642c2391819dbaa0884e53e92f3" exitCode=0 Nov 03 19:50:52.373651 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.373555 5024 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="3fea4a4f30a9814311ec370b1e28ccc8ad02bc8407af64ec76074e2a8f770bea" exitCode=0 Nov 03 19:50:52.373651 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.373562 5024 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="62a19ba1919885bafedd3e766a80ae9b67bce13a59e8b37509d50adc292789a2" exitCode=0 Nov 03 19:50:52.373651 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.373567 5024 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="b1f6d641efc1bd3b2a517810a0bfc23ce69537df4d74b356b398ff8911d9e045" exitCode=0 Nov 03 19:50:52.373651 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.373572 5024 generic.go:356] "Generic (PLEG): container finished" podID="e91996ad-4da7-45d6-89af-c384db0d8211" containerID="69954a0c4cf903b0c0308aaea38931190e29dff5621c46c69f911d5141c41936" exitCode=0 Nov 03 19:50:52.390461 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.390444 5024 manager.go:324] Recovery completed Nov 03 19:50:52.394464 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.394441 5024 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:52.407625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.407554 5024 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:52.408792 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.408768 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:52.408882 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.408803 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:52.408882 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.408818 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:52.410988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.410969 5024 cpu_manager.go:226] "Starting" policy="none" Nov 03 19:50:52.410988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.410985 5024 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 03 19:50:52.411136 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.410991 5024 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:52.411136 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411004 5024 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 03 19:50:52.411229 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411149 5024 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 03 19:50:52.411229 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411163 5024 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 03 19:50:52.411229 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411183 5024 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 03 19:50:52.411229 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411188 5024 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 03 19:50:52.411229 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411194 5024 policy_none.go:50] "Start" Nov 03 19:50:52.411229 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411202 5024 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 03 19:50:52.411229 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411212 5024 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 03 19:50:52.411515 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411404 5024 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 03 19:50:52.411515 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411412 5024 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 03 19:50:52.411515 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.411419 5024 policy_none.go:44] "Start" Nov 03 19:50:52.414678 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.414654 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:52.414774 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.414688 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:52.414774 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.414699 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:52.417282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.417248 5024 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 03 19:50:52.419720 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.419706 5024 manager.go:341] "Starting Device Plugin manager" Nov 03 19:50:52.419805 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.419730 5024 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 03 19:50:52.419805 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.419738 5024 server.go:87] "Starting device plugin registration server" Nov 03 19:50:52.420056 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.420045 5024 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 03 19:50:52.420093 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.420058 5024 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 03 19:50:52.420172 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.420157 5024 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 03 19:50:52.420276 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.420246 5024 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 03 19:50:52.420327 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.420292 5024 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 03 19:50:52.420327 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.420299 5024 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 03 19:50:52.420420 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.420347 5024 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-03T19:50:52.420275749Z","UUID":"51952b70-8055-4a04-abb2-527592bfb0e2","Handler":null,"Name":"","Endpoint":""} Nov 03 19:50:52.421800 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.421779 5024 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 03 19:50:52.422557 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.422539 5024 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" Nov 03 19:50:52.422640 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.422605 5024 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 03 19:50:52.422640 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.422625 5024 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 03 19:50:52.427613 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.427582 5024 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal"] Nov 03 19:50:52.427720 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.427708 5024 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:52.428470 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.428455 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:52.428532 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.428483 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:52.428532 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.428497 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:52.428867 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.428850 5024 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:52.429009 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.428997 5024 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:52.429625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.429607 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:52.429726 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.429625 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:52.429726 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.429635 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:52.429726 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.429644 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:52.429726 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.429651 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:52.429726 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.429658 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:52.429958 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.429808 5024 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.430054 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430020 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"2be11478d32fa8c827db5f33a49eaff7","Type":"ContainerStarted","Data":"0d98f1a0ce5ad923a200d686262c0f43083b9d606f63502aa277ac8a249e8c3a"} Nov 03 19:50:52.430100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430064 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"2be11478d32fa8c827db5f33a49eaff7","Type":"ContainerStarted","Data":"16e9ad9d37eb87c8286262b1d3b99a4bb3e73581d80b84fbbb6ff1aab8efbe92"} Nov 03 19:50:52.430100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430093 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"095256848cfdd23f0d4ac6f78af21242","Type":"ContainerStarted","Data":"35299d0da988adbefa954a4445efd4ff82cabd948be4f244de7617167571e056"} Nov 03 19:50:52.430184 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430109 5024 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:52.430184 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430113 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"095256848cfdd23f0d4ac6f78af21242","Type":"ContainerDied","Data":"6dd8a6f875be91879594c19d11491694c5678017a3f11a568ff892b0e78b98b4"} Nov 03 19:50:52.430184 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430131 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" event={"ID":"095256848cfdd23f0d4ac6f78af21242","Type":"ContainerStarted","Data":"aea0d2eb391293301f0f02c2e772d49b63f2410d2f040092f73dc45b3c30f8b2"} Nov 03 19:50:52.430917 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430902 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:52.430917 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430920 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:52.431036 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.430960 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:52.431075 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.431064 5024 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-64.us-west-1.compute.internal\" not found" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.491251 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.491217 5024 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 03 19:50:52.492132 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.492118 5024 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:52.492235 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.492218 5024 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:52.492333 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.492318 5024 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:52.495360 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.495348 5024 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.520559 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.520533 5024 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 03 19:50:52.521602 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.521586 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientMemory" Nov 03 19:50:52.521684 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.521616 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasNoDiskPressure" Nov 03 19:50:52.521684 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.521637 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeHasSufficientPID" Nov 03 19:50:52.521684 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.521679 5024 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.542053 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.542025 5024 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 03 19:50:52.582499 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.582471 5024 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:52.582667 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.582521 5024 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.582667 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.582537 5024 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.591592 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.591563 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.591681 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.591617 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.591718 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.591696 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be11478d32fa8c827db5f33a49eaff7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"2be11478d32fa8c827db5f33a49eaff7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.634232 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.634202 5024 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.634372 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.634284 5024 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.634893 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.634877 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeNotReady" Nov 03 19:50:52.635004 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.634906 5024 setters.go:546] "Node became not ready" node="ip-10-0-131-64.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-03T19:50:52Z","lastTransitionTime":"2026-11-03T19:50:52Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"} Nov 03 19:50:52.655382 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.655361 5024 nodeinfomanager.go:471] existing CSINode "ip-10-0-131-64.us-west-1.compute.internal" is owned by different node (oldNodeID="18ddebf1-6852-4d1c-b5c8-b3c46330fcb2", newNodeID=""), cleaning up... Nov 03 19:50:52.655469 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.655436 5024 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:52.655564 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:52.655478 5024 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.692645 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.692592 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.692645 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.692617 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.692645 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.692633 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be11478d32fa8c827db5f33a49eaff7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"2be11478d32fa8c827db5f33a49eaff7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.692784 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.692682 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2be11478d32fa8c827db5f33a49eaff7-config\") pod \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"2be11478d32fa8c827db5f33a49eaff7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.692784 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.692701 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.692784 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.692715 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/095256848cfdd23f0d4ac6f78af21242-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" (UID: \"095256848cfdd23f0d4ac6f78af21242\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:52.903647 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.903623 5024 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-131-64.us-west-1.compute.internal" event="NodeReady" Nov 03 19:50:52.903789 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:52.903709 5024 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 03 19:50:53.279612 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.279576 5024 apiserver.go:52] "Watching apiserver" Nov 03 19:50:53.384814 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.384789 5024 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:53.384984 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.384894 5024 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:53.432798 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.432770 5024 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 03 19:50:53.433492 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.433469 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-vzcq7","openshift-network-console/networking-console-plugin-86c478bb88-wnz6t","openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-vmrhq","openshift-dns/node-resolver-mmsnt","openshift-image-registry/image-registry-7467cc6f4d-k57z9","kube-system/global-pull-secret-syncer-jllnn","openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm","openshift-insights/insights-runtime-extractor-dhz4z","openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz","openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg","openshift-ingress/router-default-85d7978dc5-vflbf","openshift-console-operator/console-operator-7cd56b8dbc-7bmz4","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2","kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal","openshift-image-registry/image-registry-65fbcd98c7-5nj47","openshift-insights/insights-operator-7c4986d449-5tccb","openshift-monitoring/cluster-monitoring-operator-884576c57-24f98","openshift-insights/periodic-gathering-p7nwb-5jxp7","openshift-cluster-node-tuning-operator/tuned-dqb5g","kube-system/konnectivity-agent-25m4r","openshift-network-operator/iptables-alerter-gwtgg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w","openshift-network-diagnostics/network-check-target-rnq79","kube-system/kas-connection-checker-685895c7c9-bf2vl","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g","kube-system/kas-connection-checker-685895c7c9-sk2cf","openshift-image-registry/node-ca-bfjzb","openshift-ovn-kubernetes/ovnkube-node-xgbcv","openshift-multus/multus-cgd84","openshift-ingress-canary/ingress-canary-9924w","kube-system/kas-connection-checker-685895c7c9-jv7xp","openshift-dns/dns-default-hsxlr","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6"] Nov 03 19:50:53.434649 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.434632 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:53.435558 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.435542 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:53.435894 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.435876 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.437414 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.437397 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.438187 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.438171 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:53.439293 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.439277 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:53.446582 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.446562 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.447307 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.447289 5024 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:53.447404 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.447339 5024 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:53.447677 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.447663 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.447877 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.447855 5024 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 03 19:50:53.447979 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.447905 5024 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-64.us-west-1.compute.internal" Nov 03 19:50:53.448958 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.448944 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.487531 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.487502 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.488067 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.488049 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.488756 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.488735 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 03 19:50:53.488953 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.488922 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 03 19:50:53.489049 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489037 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 03 19:50:53.489219 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489201 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 03 19:50:53.489280 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489239 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 03 19:50:53.489280 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489242 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.489358 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489294 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 03 19:50:53.489358 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489305 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 03 19:50:53.489358 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489340 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 03 19:50:53.489714 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.489702 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 03 19:50:53.490120 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.490104 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 03 19:50:53.490120 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.490115 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 03 19:50:53.490204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.490172 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 03 19:50:53.490869 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.490858 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 03 19:50:53.496712 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.496694 5024 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 03 19:50:53.496953 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.496919 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-dbus\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.497027 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.496965 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.497027 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.496997 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkbn9\" (UniqueName: \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.497100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497034 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-host\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.497100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497061 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cni-binary-copy\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.497165 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497108 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-node-log\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.497165 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497133 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.497165 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497157 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-hostroot\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.497257 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497174 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-host-slash\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:53.497257 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497211 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-netd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.497257 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497244 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c76f66cb-43f9-4ce9-8ce4-04f241205199-serving-cert\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.497393 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497303 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.497393 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497336 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-modprobe-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.497393 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497361 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6dnv\" (UniqueName: \"kubernetes.io/projected/302d2c96-e159-4e58-9923-ceadd49d60b5-kube-api-access-z6dnv\") pod \"migrator-66df5d496b-x7ftg\" (UID: \"302d2c96-e159-4e58-9923-ceadd49d60b5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" Nov 03 19:50:53.497496 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497418 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9gnm\" (UniqueName: \"kubernetes.io/projected/d13c24d6-6885-4eb9-952c-1c366b8d775b-kube-api-access-r9gnm\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:53.497496 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497449 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c76f66cb-43f9-4ce9-8ce4-04f241205199-serving-cert\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.497600 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497492 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:53.497600 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497560 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-stats-auth\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.497600 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497578 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-system-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.497600 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497597 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cnibin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.497782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497613 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.497782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497637 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frwrj\" (UniqueName: \"kubernetes.io/projected/98ee3610-e8cb-420a-a400-60cadd3d0d8c-kube-api-access-frwrj\") pod \"volume-data-source-validator-58c9f5f46d-4k9r6\" (UID: \"98ee3610-e8cb-420a-a400-60cadd3d0d8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" Nov 03 19:50:53.497782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497673 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fp84f\" (UniqueName: \"kubernetes.io/projected/0541c396-e42d-45e3-abe6-70b647e84341-kube-api-access-fp84f\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:53.497782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497741 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-config\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.497988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497805 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-stats-auth\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.497988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497822 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cp6q\" (UniqueName: \"kubernetes.io/projected/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kube-api-access-7cp6q\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.497988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497852 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.497988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497870 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.497988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497896 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-env-overrides\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.497921 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j57c\" (UniqueName: \"kubernetes.io/projected/c76f66cb-43f9-4ce9-8ce4-04f241205199-kube-api-access-7j57c\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498012 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498028 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-crio-socket\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498044 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-multus\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498064 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-conf-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498078 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-etc-kubernetes\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498111 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3eeb01d-abf0-404d-bae0-5810acc09628-konnectivity-ca\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498131 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlvx8\" (UniqueName: \"kubernetes.io/projected/4e4667ad-2be3-4e3c-850b-fef51ceb0513-kube-api-access-rlvx8\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498175 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498192 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498229 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46n9z\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.498239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498239 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498316 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498415 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkk8q\" (UniqueName: \"kubernetes.io/projected/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-kube-api-access-rkk8q\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498433 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498450 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-netns\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498466 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498482 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498497 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498521 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-conf\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498538 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvj6d\" (UniqueName: \"kubernetes.io/projected/618261dd-822b-486a-8cd0-40b16e371320-kube-api-access-gvj6d\") pod \"kas-connection-checker-685895c7c9-bf2vl\" (UID: \"618261dd-822b-486a-8cd0-40b16e371320\") " pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498553 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-trusted-ca\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498571 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.498644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498590 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-var-lib-kubelet\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498686 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-systemd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498715 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-655qz\" (UniqueName: \"kubernetes.io/projected/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-kube-api-access-655qz\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498734 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498752 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-iptables-alerter-script\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498769 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498788 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498805 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxjb9\" (UniqueName: \"kubernetes.io/projected/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-kube-api-access-sxjb9\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498865 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498919 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.498954 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/059455b4-e54c-4e09-9115-c264a98d5d29-hosts-file\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499001 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13c24d6-6885-4eb9-952c-1c366b8d775b-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499031 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499055 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499079 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499127 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13c24d6-6885-4eb9-952c-1c366b8d775b-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499137 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-multus-certs\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.499175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499185 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499204 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499233 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k676g\" (UniqueName: \"kubernetes.io/projected/1bd2844b-9872-446c-a13f-e44cf3b448f1-kube-api-access-k676g\") pod \"network-check-source-6f78d59f99-shrbz\" (UID: \"1bd2844b-9872-446c-a13f-e44cf3b448f1\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499272 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-kubelet\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499292 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-config\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499378 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-run\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499416 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-default-certificate\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499531 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499554 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq9xh\" (UniqueName: \"kubernetes.io/projected/8960915e-29b4-4a08-a517-c0ca433f4c95-kube-api-access-qq9xh\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499569 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55b3ebe4-88ee-440e-9eba-e67098391841-host\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499585 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499602 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499620 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-default-certificate\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499656 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499684 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8960915e-29b4-4a08-a517-c0ca433f4c95-config-volume\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499707 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysconfig\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499734 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-tmp\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499768 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499794 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-device-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499806 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-tmp\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499809 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-sys\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499837 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499884 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3eeb01d-abf0-404d-bae0-5810acc09628-agent-certs\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:53.499944 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499918 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m42nx\" (UniqueName: \"kubernetes.io/projected/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-api-access-m42nx\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499975 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.499989 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500011 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8d2adc-7480-498a-8038-686b9efa537a-cert\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500029 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500073 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-kubelet\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500096 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-systemd-units\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500121 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500167 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0541c396-e42d-45e3-abe6-70b647e84341-serving-cert\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500205 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059455b4-e54c-4e09-9115-c264a98d5d29-tmp-dir\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500237 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vprr\" (UniqueName: \"kubernetes.io/projected/059455b4-e54c-4e09-9115-c264a98d5d29-kube-api-access-5vprr\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500266 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-systemd\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500285 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-var-lib-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500308 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500298 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0541c396-e42d-45e3-abe6-70b647e84341-serving-cert\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500330 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-lib-modules\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500373 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-service-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500385 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/059455b4-e54c-4e09-9115-c264a98d5d29-tmp-dir\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500416 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500447 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-data-volume\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500480 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500500 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500563 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-data-volume\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500571 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-tmp\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500575 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500596 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-bin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500617 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-tmp\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500642 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-etc-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500663 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-ovn\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500686 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55b3ebe4-88ee-440e-9eba-e67098391841-serviceca\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:53.500761 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500703 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h92vn\" (UniqueName: \"kubernetes.io/projected/e91996ad-4da7-45d6-89af-c384db0d8211-kube-api-access-h92vn\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500863 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-netns\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500882 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500900 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500915 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft74v\" (UniqueName: \"kubernetes.io/projected/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-kube-api-access-ft74v\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500962 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.500979 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501013 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84bnz\" (UniqueName: \"kubernetes.io/projected/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-kube-api-access-84bnz\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501028 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/811da5af-e26c-482c-99c3-14202b7d524e-serving-cert\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501044 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501063 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzxd6\" (UniqueName: \"kubernetes.io/projected/811da5af-e26c-482c-99c3-14202b7d524e-kube-api-access-hzxd6\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501078 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ef723529-7fa2-42f5-bee1-cd5a24780a78-nginx-conf\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501095 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-k8s-cni-cncf-io\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501184 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/811da5af-e26c-482c-99c3-14202b7d524e-serving-cert\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501545 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k45w4\" (UniqueName: \"kubernetes.io/projected/ff8d2adc-7480-498a-8038-686b9efa537a-kube-api-access-k45w4\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501568 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501585 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-script-lib\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501602 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501617 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8960915e-29b4-4a08-a517-c0ca433f4c95-tmp-dir\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501637 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13c24d6-6885-4eb9-952c-1c366b8d775b-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501664 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-tuned\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501687 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-bin\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501710 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501721 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8960915e-29b4-4a08-a517-c0ca433f4c95-tmp-dir\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501748 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-kubernetes\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501759 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-tuned\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501768 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-socket-dir-parent\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501786 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-daemon-config\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501860 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501890 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-slash\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501915 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-kubelet-config\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.501995 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-log-socket\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502036 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0541c396-e42d-45e3-abe6-70b647e84341-config\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502064 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-cnibin\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502094 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvcwn\" (UniqueName: \"kubernetes.io/projected/6b517d3a-c283-4a81-a5ee-bd217d966bce-kube-api-access-hvcwn\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.502125 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502140 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lvw\" (UniqueName: \"kubernetes.io/projected/616120e6-f7d2-4ca3-985d-80c1e53bc3b7-kube-api-access-44lvw\") pod \"kas-connection-checker-685895c7c9-jv7xp\" (UID: \"616120e6-f7d2-4ca3-985d-80c1e53bc3b7\") " pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502162 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502178 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dghrd\" (UniqueName: \"kubernetes.io/projected/55b3ebe4-88ee-440e-9eba-e67098391841-kube-api-access-dghrd\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502201 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502243 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b28h\" (UniqueName: \"kubernetes.io/projected/6541125d-1dbc-4699-a07b-3ce05823ca0a-kube-api-access-9b28h\") pod \"migrator-66df5d496b-r77zm\" (UID: \"6541125d-1dbc-4699-a07b-3ce05823ca0a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502305 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbngk\" (UniqueName: \"kubernetes.io/projected/9300cd63-4b10-4876-96a3-7130ff5d35c7-kube-api-access-rbngk\") pod \"kas-connection-checker-685895c7c9-sk2cf\" (UID: \"9300cd63-4b10-4876-96a3-7130ff5d35c7\") " pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502343 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvslz\" (UniqueName: \"kubernetes.io/projected/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-kube-api-access-cvslz\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502365 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502383 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzbw4\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502399 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-snapshots\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.503191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.502616 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/811da5af-e26c-482c-99c3-14202b7d524e-snapshots\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.534747 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.534684 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-62dzj\"" Nov 03 19:50:53.534747 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.534684 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ftqzb\"" Nov 03 19:50:53.573742 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.573715 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.574892 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.574872 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbngk\" (UniqueName: \"kubernetes.io/projected/9300cd63-4b10-4876-96a3-7130ff5d35c7-kube-api-access-rbngk\") pod \"kas-connection-checker-685895c7c9-sk2cf\" (UID: \"9300cd63-4b10-4876-96a3-7130ff5d35c7\") " pod="kube-system/kas-connection-checker-685895c7c9-sk2cf" Nov 03 19:50:53.575765 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.575747 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.576349 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.576329 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lvw\" (UniqueName: \"kubernetes.io/projected/616120e6-f7d2-4ca3-985d-80c1e53bc3b7-kube-api-access-44lvw\") pod \"kas-connection-checker-685895c7c9-jv7xp\" (UID: \"616120e6-f7d2-4ca3-985d-80c1e53bc3b7\") " pod="kube-system/kas-connection-checker-685895c7c9-jv7xp" Nov 03 19:50:53.577336 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.577316 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvj6d\" (UniqueName: \"kubernetes.io/projected/618261dd-822b-486a-8cd0-40b16e371320-kube-api-access-gvj6d\") pod \"kas-connection-checker-685895c7c9-bf2vl\" (UID: \"618261dd-822b-486a-8cd0-40b16e371320\") " pod="kube-system/kas-connection-checker-685895c7c9-bf2vl" Nov 03 19:50:53.586878 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586849 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 03 19:50:53.586878 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586865 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586896 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586919 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586941 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586965 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586947 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586981 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586984 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.586997 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587337 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587267 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587337 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587268 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587337 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587292 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587337 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587303 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 03 19:50:53.587337 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587309 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 03 19:50:53.587476 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587346 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587476 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587411 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 03 19:50:53.587568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587484 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587533 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587544 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587551 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587534 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587573 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587578 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587599 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587609 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587633 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587633 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587724 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587764 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587773 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 03 19:50:53.587783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587780 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587803 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 03 19:50:53.588191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.587829 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588012 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588036 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588039 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.588191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588030 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 03 19:50:53.588191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588106 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588235 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588259 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588282 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588301 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588338 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588342 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588343 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-env-overrides\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588375 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588412 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588425 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588429 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588441 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c3eeb01d-abf0-404d-bae0-5810acc09628-konnectivity-ca\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588462 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 03 19:50:53.588490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588492 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 03 19:50:53.589061 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588554 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.589061 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588584 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:53.589061 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588629 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:50:53.589061 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.588655 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 03 19:50:53.589265 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589097 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqnxf\" (UniqueName: \"kubernetes.io/projected/bb1c6275-037e-44d2-89c0-8bb80d832a11-kube-api-access-jqnxf\") pod \"network-check-target-rnq79\" (UID: \"bb1c6275-037e-44d2-89c0-8bb80d832a11\") " pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:53.589265 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589196 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-iptables-alerter-script\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589477 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589515 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589521 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j57c\" (UniqueName: \"kubernetes.io/projected/c76f66cb-43f9-4ce9-8ce4-04f241205199-kube-api-access-7j57c\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589556 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft74v\" (UniqueName: \"kubernetes.io/projected/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-kube-api-access-ft74v\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589614 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-config\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.589905 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq9xh\" (UniqueName: \"kubernetes.io/projected/8960915e-29b4-4a08-a517-c0ca433f4c95-kube-api-access-qq9xh\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590159 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvcwn\" (UniqueName: \"kubernetes.io/projected/6b517d3a-c283-4a81-a5ee-bd217d966bce-kube-api-access-hvcwn\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590165 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8960915e-29b4-4a08-a517-c0ca433f4c95-config-volume\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590298 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkk8q\" (UniqueName: \"kubernetes.io/projected/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-kube-api-access-rkk8q\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:53.590654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590518 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cp6q\" (UniqueName: \"kubernetes.io/projected/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kube-api-access-7cp6q\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590663 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-655qz\" (UniqueName: \"kubernetes.io/projected/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-kube-api-access-655qz\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590731 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e91996ad-4da7-45d6-89af-c384db0d8211-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590741 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvslz\" (UniqueName: \"kubernetes.io/projected/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-kube-api-access-cvslz\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590828 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bfjzb_55b3ebe4-88ee-440e-9eba-e67098391841/node-ca/0.log" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590833 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-service-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590878 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55b3ebe4-88ee-440e-9eba-e67098391841-serviceca\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590917 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dghrd\" (UniqueName: \"kubernetes.io/projected/55b3ebe4-88ee-440e-9eba-e67098391841-kube-api-access-dghrd\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.590980 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.591163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.591133 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.591534 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.591473 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k676g\" (UniqueName: \"kubernetes.io/projected/1bd2844b-9872-446c-a13f-e44cf3b448f1-kube-api-access-k676g\") pod \"network-check-source-6f78d59f99-shrbz\" (UID: \"1bd2844b-9872-446c-a13f-e44cf3b448f1\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-shrbz" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.591824 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84bnz\" (UniqueName: \"kubernetes.io/projected/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-kube-api-access-84bnz\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.591914 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b28h\" (UniqueName: \"kubernetes.io/projected/6541125d-1dbc-4699-a07b-3ce05823ca0a-kube-api-access-9b28h\") pod \"migrator-66df5d496b-r77zm\" (UID: \"6541125d-1dbc-4699-a07b-3ce05823ca0a\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-r77zm" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.592122 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ef723529-7fa2-42f5-bee1-cd5a24780a78-nginx-conf\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.592278 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0541c396-e42d-45e3-abe6-70b647e84341-config\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.592445 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-daemon-config\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.592483 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzbw4\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.592874 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fp84f\" (UniqueName: \"kubernetes.io/projected/0541c396-e42d-45e3-abe6-70b647e84341-kube-api-access-fp84f\") pod \"service-ca-operator-544d749c8c-mr5f4\" (UID: \"0541c396-e42d-45e3-abe6-70b647e84341\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.592900 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6dnv\" (UniqueName: \"kubernetes.io/projected/302d2c96-e159-4e58-9923-ceadd49d60b5-kube-api-access-z6dnv\") pod \"migrator-66df5d496b-x7ftg\" (UID: \"302d2c96-e159-4e58-9923-ceadd49d60b5\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x7ftg" Nov 03 19:50:53.593860 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.593570 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzxd6\" (UniqueName: \"kubernetes.io/projected/811da5af-e26c-482c-99c3-14202b7d524e-kube-api-access-hzxd6\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.594236 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.593878 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13c24d6-6885-4eb9-952c-1c366b8d775b-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:53.595297 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.595274 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46n9z\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.595377 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.595362 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k45w4\" (UniqueName: \"kubernetes.io/projected/ff8d2adc-7480-498a-8038-686b9efa537a-kube-api-access-k45w4\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:53.595438 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.595363 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h92vn\" (UniqueName: \"kubernetes.io/projected/e91996ad-4da7-45d6-89af-c384db0d8211-kube-api-access-h92vn\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.595631 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.595612 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxjb9\" (UniqueName: \"kubernetes.io/projected/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-kube-api-access-sxjb9\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:53.595707 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.595687 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vprr\" (UniqueName: \"kubernetes.io/projected/059455b4-e54c-4e09-9115-c264a98d5d29-kube-api-access-5vprr\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:53.596655 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.596639 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m42nx\" (UniqueName: \"kubernetes.io/projected/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-api-access-m42nx\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.597678 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.597662 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cni-binary-copy\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.598163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.598144 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkbn9\" (UniqueName: \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.598258 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.598239 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlvx8\" (UniqueName: \"kubernetes.io/projected/4e4667ad-2be3-4e3c-850b-fef51ceb0513-kube-api-access-rlvx8\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:53.598326 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.598313 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-config\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.598597 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.598583 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frwrj\" (UniqueName: \"kubernetes.io/projected/98ee3610-e8cb-420a-a400-60cadd3d0d8c-kube-api-access-frwrj\") pod \"volume-data-source-validator-58c9f5f46d-4k9r6\" (UID: \"98ee3610-e8cb-420a-a400-60cadd3d0d8c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-4k9r6" Nov 03 19:50:53.598921 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.598906 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9gnm\" (UniqueName: \"kubernetes.io/projected/d13c24d6-6885-4eb9-952c-1c366b8d775b-kube-api-access-r9gnm\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2\" (UID: \"d13c24d6-6885-4eb9-952c-1c366b8d775b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" Nov 03 19:50:53.603244 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603227 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-netns\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.603289 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603253 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.603289 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603268 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.603289 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603282 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-conf\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.603432 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603296 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-var-lib-kubelet\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.603432 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603326 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-netns\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.603432 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603364 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.603432 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603390 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-systemd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.603432 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603420 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-conf\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.603432 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603424 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-var-lib-kubelet\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.603432 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603420 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603458 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/059455b4-e54c-4e09-9115-c264a98d5d29-hosts-file\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603463 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-systemd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603486 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603510 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603513 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603489 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/059455b4-e54c-4e09-9115-c264a98d5d29-hosts-file\") pod \"node-resolver-mmsnt\" (UID: \"059455b4-e54c-4e09-9115-c264a98d5d29\") " pod="openshift-dns/node-resolver-mmsnt" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.603533 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.103512529 +0000 UTC m=+1.885229189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : configmap references non-existent config key: service-ca.crt Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603540 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-sys-fs\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603561 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603577 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-multus-certs\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603593 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-kubelet\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603590 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603614 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-run\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603626 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-multus-certs\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603631 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-kubelet\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603634 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603649 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55b3ebe4-88ee-440e-9eba-e67098391841-host\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:53.603650 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603658 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-run\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603663 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603680 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603696 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysconfig\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603700 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55b3ebe4-88ee-440e-9eba-e67098391841-host\") pod \"node-ca-bfjzb\" (UID: \"55b3ebe4-88ee-440e-9eba-e67098391841\") " pod="openshift-image-registry/node-ca-bfjzb" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603727 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-socket-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603728 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysconfig\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603739 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603761 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-device-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603773 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-sys\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.603784 5024 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603790 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603805 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-registration-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603808 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-kubelet\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603819 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2df91d19-7cca-4ca4-b47a-f1246e6c5ee5-device-dir\") pod \"aws-ebs-csi-driver-node-gkr6w\" (UID: \"2df91d19-7cca-4ca4-b47a-f1246e6c5ee5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkr6w" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.603843 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.103828941 +0000 UTC m=+1.885545613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603845 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-kubelet\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603833 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-sys\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603859 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-systemd-units\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603886 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-systemd\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.603896 5024 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603909 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-var-lib-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603946 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-systemd\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603955 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-var-lib-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603948 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-lib-modules\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603911 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-systemd-units\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.603992 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604004 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.103986832 +0000 UTC m=+1.885703505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604042 5024 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604059 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-lib-modules\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604069 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-bin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604095 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls podName:4e4667ad-2be3-4e3c-850b-fef51ceb0513 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.104080818 +0000 UTC m=+1.885797463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-lcv5g" (UID: "4e4667ad-2be3-4e3c-850b-fef51ceb0513") : secret "samples-operator-tls" not found Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604099 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-bin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604109 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-etc-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604128 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-ovn\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604152 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-netns\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604162 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-etc-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604175 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-ovn\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604178 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604201 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-netns\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604204 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604217 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-system-cni-dir\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604233 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-k8s-cni-cncf-io\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604239 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-run-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604259 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604286 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-bin\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604303 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-kubernetes\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.604288 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604314 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-run-k8s-cni-cncf-io\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604318 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-socket-dir-parent\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604342 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604354 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-bin\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604358 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604374 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-socket-dir-parent\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604384 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-slash\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604398 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-kubernetes\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604407 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-kubelet-config\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604430 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-log-socket\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604444 5024 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604444 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-kubelet-config\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604454 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-cnibin\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604476 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-log-socket\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604481 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604492 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.104479763 +0000 UTC m=+1.886196424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604442 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-slash\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604500 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e91996ad-4da7-45d6-89af-c384db0d8211-cnibin\") pod \"multus-additional-cni-plugins-vmrhq\" (UID: \"e91996ad-4da7-45d6-89af-c384db0d8211\") " pod="openshift-multus/multus-additional-cni-plugins-vmrhq" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604519 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604543 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-dbus\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604558 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604523 5024 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604605 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.104595146 +0000 UTC m=+1.886311791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : configmap "kube-rbac-proxy" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604573 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-host\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604615 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-run-openvswitch\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604620 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/62ac74a8-8df8-48fd-8a09-9ce51991bd84-dbus\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604604 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-host\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604629 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-node-log\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604651 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-node-log\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604661 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604678 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-hostroot\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604704 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-sysctl-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604701 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-host-slash\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604729 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-netd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604739 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/616c46b6-a9fb-4a1c-b10d-b6d623f97ddd-host-slash\") pod \"iptables-alerter-gwtgg\" (UID: \"616c46b6-a9fb-4a1c-b10d-b6d623f97ddd\") " pod="openshift-network-operator/iptables-alerter-gwtgg" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604756 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-modprobe-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604729 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-hostroot\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604776 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-system-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604799 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-host-cni-netd\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604805 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cnibin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604841 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604846 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-cnibin\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604809 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-system-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604859 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9-etc-modprobe-d\") pod \"tuned-dqb5g\" (UID: \"76731d78-a2c0-4a6b-a4f0-f1bdfa02c7c9\") " pod="openshift-cluster-node-tuning-operator/tuned-dqb5g" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604868 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604889 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604911 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-crio-socket\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604921 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604949 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604948 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-multus\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604970 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-conf-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604966 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-cni-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604989 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.604998 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.104984124 +0000 UTC m=+1.886700768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.605002 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.605009 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-host-var-lib-cni-multus\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.605026 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-multus-conf-dir\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.605027 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-etc-kubernetes\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.605038 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc-etc-kubernetes\") pod \"multus-cgd84\" (UID: \"da57dcaf-f5c2-47ef-9ea5-6b12a0a71dbc\") " pod="openshift-multus/multus-cgd84" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.604988 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-crio-socket\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.605048 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.105035364 +0000 UTC m=+1.886752024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:53.605824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.605486 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:53.638014 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.637971 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 03 19:50:53.638363 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638317 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 03 19:50:53.638363 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638324 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 03 19:50:53.638363 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638324 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638400 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-d855x\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638407 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638464 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-dtr2r\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638476 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638504 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638506 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638523 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5c7z7\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638530 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pc2lm\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638535 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 03 19:50:53.638562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638557 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638581 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-9gdsm\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638594 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4nq97\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638596 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638606 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-926lf\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638599 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n4htx\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638608 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fsnsn\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638616 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tfxx4\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638632 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-b5t9k\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638633 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pvbsg\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638642 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzphm\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638665 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dqdcf\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638682 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tvtfw\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638682 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-72xbf\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638762 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 03 19:50:53.638902 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.638774 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 03 19:50:53.639331 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.639100 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c76f66cb-43f9-4ce9-8ce4-04f241205199-trusted-ca\") pod \"console-operator-7cd56b8dbc-7bmz4\" (UID: \"c76f66cb-43f9-4ce9-8ce4-04f241205199\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:53.639331 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.639112 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovn-node-metrics-cert\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.640043 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.640029 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\") pod \"periodic-gathering-p7nwb-5jxp7\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:50:53.640215 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.640199 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c3eeb01d-abf0-404d-bae0-5810acc09628-agent-certs\") pod \"konnectivity-agent-25m4r\" (UID: \"c3eeb01d-abf0-404d-bae0-5810acc09628\") " pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:50:53.640283 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.640272 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff8d2adc-7480-498a-8038-686b9efa537a-cert\") pod \"ingress-canary-9924w\" (UID: \"ff8d2adc-7480-498a-8038-686b9efa537a\") " pod="openshift-ingress-canary/ingress-canary-9924w" Nov 03 19:50:53.642191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.642175 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1687e9c0-54ea-45aa-accd-ebfcf8cc9efa-ovnkube-script-lib\") pod \"ovnkube-node-xgbcv\" (UID: \"1687e9c0-54ea-45aa-accd-ebfcf8cc9efa\") " pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:50:53.642490 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.642475 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:53.642620 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.642604 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:53.644289 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.644274 5024 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:53.644346 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.644282 5024 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 19:50:53.644346 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.644342 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.144322211 +0000 UTC m=+1.926038887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:53.644419 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.644370 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.144358448 +0000 UTC m=+1.926075092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : secret "metrics-daemon-secret" not found Nov 03 19:50:53.645515 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.645504 5024 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:53.645548 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:53.645530 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:54.145523819 +0000 UTC m=+1.927240464 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:53.647856 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.647840 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:53.649029 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.649011 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/811da5af-e26c-482c-99c3-14202b7d524e-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-5tccb\" (UID: \"811da5af-e26c-482c-99c3-14202b7d524e\") " pod="openshift-insights/insights-operator-7c4986d449-5tccb" Nov 03 19:50:53.649096 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.649071 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/62ac74a8-8df8-48fd-8a09-9ce51991bd84-original-pull-secret\") pod \"global-pull-secret-syncer-jllnn\" (UID: \"62ac74a8-8df8-48fd-8a09-9ce51991bd84\") " pod="kube-system/global-pull-secret-syncer-jllnn" Nov 03 19:50:53.735381 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.735351 5024 scope.go:122] "RemoveContainer" containerID="fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b" Nov 03 19:50:53.930803 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:53.930775 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:54.111069 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.110991 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:54.111069 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111024 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:54.111069 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111063 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111096 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111137 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111141 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111150 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111162 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111169 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111174 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111220 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.111202331 +0000 UTC m=+2.892918990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111238 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.111229294 +0000 UTC m=+2.892945942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111250 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.111244605 +0000 UTC m=+2.892961249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : configmap references non-existent config key: service-ca.crt Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111253 5024 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111254 5024 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111266 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111280 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls podName:4e4667ad-2be3-4e3c-850b-fef51ceb0513 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.111268935 +0000 UTC m=+2.892985579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-lcv5g" (UID: "4e4667ad-2be3-4e3c-850b-fef51ceb0513") : secret "samples-operator-tls" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111300 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.111289727 +0000 UTC m=+2.893006391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:54.111306 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111312 5024 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:54.111752 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111336 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.111329981 +0000 UTC m=+2.893046625 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:54.111752 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111336 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:54.111752 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111254 5024 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:54.111752 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.111407 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.111396301 +0000 UTC m=+2.893112945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:54.111862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.111756 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:54.177702 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.177674 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:54.191892 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.191870 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9924w_ff8d2adc-7480-498a-8038-686b9efa537a/serve-healthcheck-canary/0.log" Nov 03 19:50:54.212250 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.212228 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:54.212342 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.212279 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:54.212342 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.212325 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:54.212440 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.212372 5024 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:54.212440 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.212431 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.212414754 +0000 UTC m=+2.994131414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:54.212520 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.212440 5024 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:54.212520 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.212440 5024 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 03 19:50:54.212520 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.212483 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs podName:b7095bf3-9ab1-47b1-a14e-aeda90c64cd8 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.212471153 +0000 UTC m=+2.994187882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs") pod "network-metrics-daemon-vzcq7" (UID: "b7095bf3-9ab1-47b1-a14e-aeda90c64cd8") : secret "metrics-daemon-secret" not found Nov 03 19:50:54.212520 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.212497 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:55.212490422 +0000 UTC m=+2.994207066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:54.389562 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.389538 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 19:50:54.390001 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.389955 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/1.log" Nov 03 19:50:54.390001 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.389990 5024 generic.go:356] "Generic (PLEG): container finished" podID="c76f66cb-43f9-4ce9-8ce4-04f241205199" containerID="28650fbfa687cac778ca739c8275e54469956c0652d78bc5661b25c08e5b40fd" exitCode=255 Nov 03 19:50:54.390123 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.390066 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" event={"ID":"c76f66cb-43f9-4ce9-8ce4-04f241205199","Type":"ContainerDied","Data":"28650fbfa687cac778ca739c8275e54469956c0652d78bc5661b25c08e5b40fd"} Nov 03 19:50:54.390123 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.390112 5024 scope.go:122] "RemoveContainer" containerID="fcee5d7ee4741ae9cbd663664ea5a57e1ce3b436be6b873b29c2d16a37eb358b" Nov 03 19:50:54.390605 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.390590 5024 scope.go:122] "RemoveContainer" containerID="28650fbfa687cac778ca739c8275e54469956c0652d78bc5661b25c08e5b40fd" Nov 03 19:50:54.390783 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:54.390766 5024 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-7bmz4_openshift-console-operator(c76f66cb-43f9-4ce9-8ce4-04f241205199)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" podUID="c76f66cb-43f9-4ce9-8ce4-04f241205199" Nov 03 19:50:54.600250 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.600222 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-r77zm_6541125d-1dbc-4699-a07b-3ce05823ca0a/migrator/0.log" Nov 03 19:50:54.635434 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.635407 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:54.820736 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.820663 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-x7ftg_302d2c96-e159-4e58-9923-ceadd49d60b5/migrator/0.log" Nov 03 19:50:54.990665 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:54.990635 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2_d13c24d6-6885-4eb9-952c-1c366b8d775b/kube-storage-version-migrator-operator/0.log" Nov 03 19:50:55.048805 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.048752 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:55.120989 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.120875 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:55.120989 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.120909 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:55.120989 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.120977 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.121008 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121043 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.121050 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121060 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.121088 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121105 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121118 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:57.121098767 +0000 UTC m=+4.902815433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121123 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121133 5024 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.121162 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121177 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:50:57.121160964 +0000 UTC m=+4.902877652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121190 5024 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121215 5024 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:55.121224 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121223 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs podName:6b517d3a-c283-4a81-a5ee-bd217d966bce nodeName:}" failed. No retries permitted until 2026-11-03 19:50:57.121203691 +0000 UTC m=+4.902920350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs") pod "router-default-85d7978dc5-vflbf" (UID: "6b517d3a-c283-4a81-a5ee-bd217d966bce") : secret "router-metrics-certs-default" not found Nov 03 19:50:55.121697 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121252 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:57.121240079 +0000 UTC m=+4.902956725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:55.121697 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.121271 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls podName:cbebc1f6-9c14-406d-a918-f6857cc5b2cf nodeName:}" failed. No retries permitted until 2026-11-03 19:50:57.121261919 +0000 UTC m=+4.902978563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-24f98" (UID: "cbebc1f6-9c14-406d-a918-f6857cc5b2cf") : secret "cluster-monitoring-operator-tls" not found Nov 03 19:50:55.121697 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.121390 5024 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 03 19:50:55.121697 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.121627 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b517d3a-c283-4a81-a5ee-bd217d966bce-service-ca-bundle\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:55.123518 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.123502 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4e4667ad-2be3-4e3c-850b-fef51ceb0513-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-lcv5g\" (UID: \"4e4667ad-2be3-4e3c-850b-fef51ceb0513\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:55.222313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.222278 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:55.222462 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.222332 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:55.222462 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.222374 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:55.222462 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.222416 5024 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 03 19:50:55.222597 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.222475 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls podName:8960915e-29b4-4a08-a517-c0ca433f4c95 nodeName:}" failed. No retries permitted until 2026-11-03 19:50:57.222461219 +0000 UTC m=+5.004177869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls") pod "dns-default-hsxlr" (UID: "8960915e-29b4-4a08-a517-c0ca433f4c95") : secret "dns-default-metrics-tls" not found Nov 03 19:50:55.222597 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.222476 5024 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:55.222597 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:55.222526 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:50:57.222513313 +0000 UTC m=+5.004229958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:55.224660 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.224644 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7095bf3-9ab1-47b1-a14e-aeda90c64cd8-metrics-certs\") pod \"network-metrics-daemon-vzcq7\" (UID: \"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8\") " pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:55.235645 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.235624 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" Nov 03 19:50:55.240762 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.240733 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vzcq7" Nov 03 19:50:55.243604 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.243583 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:55.395588 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.395561 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 19:50:55.423081 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.423048 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:55.581021 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.580988 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:50:55.665242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.665156 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vzcq7"] Nov 03 19:50:55.668185 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:55.668154 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7095bf3_9ab1_47b1_a14e_aeda90c64cd8.slice/crio-726f5d08518c003625e0723d4b9260ff3cc6d66f1fba18fa44301f3cd9f7a18a WatchSource:0}: Error finding container 726f5d08518c003625e0723d4b9260ff3cc6d66f1fba18fa44301f3cd9f7a18a: Status 404 returned error can't find the container with id 726f5d08518c003625e0723d4b9260ff3cc6d66f1fba18fa44301f3cd9f7a18a Nov 03 19:50:55.670087 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.670072 5024 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 19:50:55.695784 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:55.695757 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g"] Nov 03 19:50:56.369615 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:56.369572 5024 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:56.369970 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:56.369956 5024 scope.go:122] "RemoveContainer" containerID="28650fbfa687cac778ca739c8275e54469956c0652d78bc5661b25c08e5b40fd" Nov 03 19:50:56.370163 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:56.370145 5024 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-7bmz4_openshift-console-operator(c76f66cb-43f9-4ce9-8ce4-04f241205199)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" podUID="c76f66cb-43f9-4ce9-8ce4-04f241205199" Nov 03 19:50:56.400417 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:56.400390 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzcq7" event={"ID":"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8","Type":"ContainerStarted","Data":"726f5d08518c003625e0723d4b9260ff3cc6d66f1fba18fa44301f3cd9f7a18a"} Nov 03 19:50:56.401506 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:56.401485 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" event={"ID":"4e4667ad-2be3-4e3c-850b-fef51ceb0513","Type":"ContainerStarted","Data":"9e5fddc62c76aa7c4d43a4fd205256ce3f9fc9d65ea99fa937bae305d0af59cc"} Nov 03 19:50:56.463113 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:56.463085 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:56.663373 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:56.663340 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:56.879248 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:56.879213 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:57.062256 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.062191 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:57.068238 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.068211 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:50:57.068605 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.068586 5024 scope.go:122] "RemoveContainer" containerID="28650fbfa687cac778ca739c8275e54469956c0652d78bc5661b25c08e5b40fd" Nov 03 19:50:57.068807 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.068788 5024 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-7bmz4_openshift-console-operator(c76f66cb-43f9-4ce9-8ce4-04f241205199)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" podUID="c76f66cb-43f9-4ce9-8ce4-04f241205199" Nov 03 19:50:57.141483 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.141455 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:57.141632 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.141503 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:50:57.141632 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.141566 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:57.141763 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.141644 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:50:57.141763 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141672 5024 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 03 19:50:57.141763 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.141686 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:50:57.141763 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141728 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert podName:ef723529-7fa2-42f5-bee1-cd5a24780a78 nodeName:}" failed. No retries permitted until 2026-11-03 19:51:01.141712711 +0000 UTC m=+8.923429356 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-wnz6t" (UID: "ef723529-7fa2-42f5-bee1-cd5a24780a78") : secret "networking-console-plugin-cert" not found Nov 03 19:50:57.141894 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141787 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:57.141894 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141800 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:50:57.141894 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141845 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:51:01.141830414 +0000 UTC m=+8.923547063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:50:57.142057 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141891 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:50:57.142057 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141908 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:50:57.142057 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.141996 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:51:01.141981459 +0000 UTC m=+8.923698119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:50:57.144145 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.144124 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b517d3a-c283-4a81-a5ee-bd217d966bce-metrics-certs\") pod \"router-default-85d7978dc5-vflbf\" (UID: \"6b517d3a-c283-4a81-a5ee-bd217d966bce\") " pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:57.144309 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.144288 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbebc1f6-9c14-406d-a918-f6857cc5b2cf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-24f98\" (UID: \"cbebc1f6-9c14-406d-a918-f6857cc5b2cf\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:57.243394 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.243361 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:57.243540 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.243519 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:50:57.243776 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.243755 5024 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 03 19:50:57.243874 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:50:57.243809 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls podName:a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f nodeName:}" failed. No retries permitted until 2026-11-03 19:51:01.24379471 +0000 UTC m=+9.025511355 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dhz4z" (UID: "a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f") : secret "insights-runtime-extractor-tls" not found Nov 03 19:50:57.246393 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.246357 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8960915e-29b4-4a08-a517-c0ca433f4c95-metrics-tls\") pod \"dns-default-hsxlr\" (UID: \"8960915e-29b4-4a08-a517-c0ca433f4c95\") " pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:57.336844 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.336764 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" Nov 03 19:50:57.337748 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.337712 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:57.338420 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.338364 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:57.348510 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.348435 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsxlr" Nov 03 19:50:57.415435 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.414398 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzcq7" event={"ID":"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8","Type":"ContainerStarted","Data":"88e58c462a1be7e7834bfcc1ee61b3fb90d9d0b1be5619c5d0e2a23093480dd5"} Nov 03 19:50:57.415945 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.415855 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vzcq7" event={"ID":"b7095bf3-9ab1-47b1-a14e-aeda90c64cd8","Type":"ContainerStarted","Data":"fd28ba752ddb3a4279da4a9c34ecb1c60cd43c66d709299c15800242844aada4"} Nov 03 19:50:57.722918 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.722887 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-24f98"] Nov 03 19:50:57.726286 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:57.726259 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbebc1f6_9c14_406d_a918_f6857cc5b2cf.slice/crio-bccbc49093ced60ce887b48037257a5bc55685d24dba96f964ef1dc3c8f7eef0 WatchSource:0}: Error finding container bccbc49093ced60ce887b48037257a5bc55685d24dba96f964ef1dc3c8f7eef0: Status 404 returned error can't find the container with id bccbc49093ced60ce887b48037257a5bc55685d24dba96f964ef1dc3c8f7eef0 Nov 03 19:50:57.767747 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.767717 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsxlr"] Nov 03 19:50:57.771119 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:57.771055 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d7978dc5-vflbf"] Nov 03 19:50:57.771829 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:57.771805 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8960915e_29b4_4a08_a517_c0ca433f4c95.slice/crio-effe497c216500a697e646405e0716ee98c263bb2f970812fac9dde8f70b0be0 WatchSource:0}: Error finding container effe497c216500a697e646405e0716ee98c263bb2f970812fac9dde8f70b0be0: Status 404 returned error can't find the container with id effe497c216500a697e646405e0716ee98c263bb2f970812fac9dde8f70b0be0 Nov 03 19:50:57.775395 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:50:57.775368 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b517d3a_c283_4a81_a5ee_bd217d966bce.slice/crio-589d81b7e46bc890d4ccae0b8ebe2e0afcefcdb7ba84cc6235910bb66e2c22ac WatchSource:0}: Error finding container 589d81b7e46bc890d4ccae0b8ebe2e0afcefcdb7ba84cc6235910bb66e2c22ac: Status 404 returned error can't find the container with id 589d81b7e46bc890d4ccae0b8ebe2e0afcefcdb7ba84cc6235910bb66e2c22ac Nov 03 19:50:58.418512 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.418469 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" event={"ID":"cbebc1f6-9c14-406d-a918-f6857cc5b2cf","Type":"ContainerStarted","Data":"bccbc49093ced60ce887b48037257a5bc55685d24dba96f964ef1dc3c8f7eef0"} Nov 03 19:50:58.419941 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.419894 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d7978dc5-vflbf" event={"ID":"6b517d3a-c283-4a81-a5ee-bd217d966bce","Type":"ContainerStarted","Data":"26d4c151a9cc9d7743e7f3fc87a41cde30171f67834182cd92e3a24250cff4c3"} Nov 03 19:50:58.420072 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.419973 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d7978dc5-vflbf" event={"ID":"6b517d3a-c283-4a81-a5ee-bd217d966bce","Type":"ContainerStarted","Data":"589d81b7e46bc890d4ccae0b8ebe2e0afcefcdb7ba84cc6235910bb66e2c22ac"} Nov 03 19:50:58.421656 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.421623 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" event={"ID":"4e4667ad-2be3-4e3c-850b-fef51ceb0513","Type":"ContainerStarted","Data":"13571d042c8a89567007af943c6ab92b628a656b09382953c2c93cff2d7c2a37"} Nov 03 19:50:58.421758 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.421662 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-lcv5g" event={"ID":"4e4667ad-2be3-4e3c-850b-fef51ceb0513","Type":"ContainerStarted","Data":"422a313c3de38e536a5cc9af4ead18dc6e9a053b4554e594ef5aea25ebcb04b6"} Nov 03 19:50:58.422847 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.422825 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsxlr" event={"ID":"8960915e-29b4-4a08-a517-c0ca433f4c95","Type":"ContainerStarted","Data":"effe497c216500a697e646405e0716ee98c263bb2f970812fac9dde8f70b0be0"} Nov 03 19:50:58.500736 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.500710 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:58.725857 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.725772 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:58.912166 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:58.912125 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:59.091466 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:59.091383 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:59.318262 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:59.318229 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:50:59.338310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:59.338193 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:50:59.341326 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:50:59.341297 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:51:00.436535 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:00.436461 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-24f98" event={"ID":"cbebc1f6-9c14-406d-a918-f6857cc5b2cf","Type":"ContainerStarted","Data":"9eec6a5c6228ccff8bb15740ccddc02a56d33eec0b783812afc1193a801b30fa"} Nov 03 19:51:00.438558 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:00.438530 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsxlr" event={"ID":"8960915e-29b4-4a08-a517-c0ca433f4c95","Type":"ContainerStarted","Data":"9c4bbe2bc7f982819a87e810c795d5fa0cc209041d2ecc19d4fbb32f35620979"} Nov 03 19:51:00.438558 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:00.438549 5024 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 19:51:00.438699 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:00.438574 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsxlr" event={"ID":"8960915e-29b4-4a08-a517-c0ca433f4c95","Type":"ContainerStarted","Data":"72d26696f064ffcddc78843cedb8768bc1aebfad79a347e279a9042e867a0f76"} Nov 03 19:51:00.584273 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:00.584217 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:00.793785 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:00.793711 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:01.160768 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.160728 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:01.178819 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.178796 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:51:01.178910 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.178851 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:01.178910 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.178869 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:51:01.179048 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:01.178974 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:51:01.179048 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:01.178979 5024 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 03 19:51:01.179048 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:01.178986 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7467cc6f4d-k57z9: secret "image-registry-tls" not found Nov 03 19:51:01.179048 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:01.178995 5024 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fbcd98c7-5nj47: secret "image-registry-tls" not found Nov 03 19:51:01.179048 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:01.179044 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls podName:0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe nodeName:}" failed. No retries permitted until 2026-11-03 19:51:09.179032544 +0000 UTC m=+16.960749188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls") pod "image-registry-7467cc6f4d-k57z9" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe") : secret "image-registry-tls" not found Nov 03 19:51:01.179265 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:01.179057 5024 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls podName:eb450369-6fdb-4f91-82ac-e6ea5b974551 nodeName:}" failed. No retries permitted until 2026-11-03 19:51:09.179051265 +0000 UTC m=+16.960767909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls") pod "image-registry-65fbcd98c7-5nj47" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551") : secret "image-registry-tls" not found Nov 03 19:51:01.181284 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.181260 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ef723529-7fa2-42f5-bee1-cd5a24780a78-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-wnz6t\" (UID: \"ef723529-7fa2-42f5-bee1-cd5a24780a78\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:51:01.239007 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.238985 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" Nov 03 19:51:01.279333 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.279306 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:51:01.281693 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.281664 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dhz4z\" (UID: \"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f\") " pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:51:01.380191 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.380159 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:01.442256 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.442182 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hsxlr" Nov 03 19:51:01.550009 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.549978 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dhz4z" Nov 03 19:51:01.570075 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.570047 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:01.609426 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.609401 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-wnz6t"] Nov 03 19:51:01.614747 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:51:01.614719 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef723529_7fa2_42f5_bee1_cd5a24780a78.slice/crio-ee5049db2972b80c3ce68346115276d5057d541fbbc127a41f8e917671d446cb WatchSource:0}: Error finding container ee5049db2972b80c3ce68346115276d5057d541fbbc127a41f8e917671d446cb: Status 404 returned error can't find the container with id ee5049db2972b80c3ce68346115276d5057d541fbbc127a41f8e917671d446cb Nov 03 19:51:01.921418 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:01.921392 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dhz4z"] Nov 03 19:51:02.330636 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:02.330559 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:02.446134 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:02.446095 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" event={"ID":"ef723529-7fa2-42f5-bee1-cd5a24780a78","Type":"ContainerStarted","Data":"ee5049db2972b80c3ce68346115276d5057d541fbbc127a41f8e917671d446cb"} Nov 03 19:51:02.447550 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:02.447523 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dhz4z" event={"ID":"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f","Type":"ContainerStarted","Data":"62458d080a6d23408fd9b5e9652b963c05f86072fa095c85d7cca3809195fe28"} Nov 03 19:51:02.447684 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:02.447580 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dhz4z" event={"ID":"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f","Type":"ContainerStarted","Data":"3544b540f60829d73bbd74fb32919866460a0b0d0ca08b604e337b65d6e33838"} Nov 03 19:51:02.766019 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:02.765987 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:02.985000 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:02.984956 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:03.207153 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:03.207116 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:03.415387 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:03.415356 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:03.452465 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:03.452431 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-wnz6t" event={"ID":"ef723529-7fa2-42f5-bee1-cd5a24780a78","Type":"ContainerStarted","Data":"3d40495eec47dd15235a04de447ca7f649fb09ba2c92aef030839dd866e4ae33"} Nov 03 19:51:03.454221 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:03.454199 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dhz4z" event={"ID":"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f","Type":"ContainerStarted","Data":"e3d0141f3149628b30c8d039892ae9e105201d896c3eea4fec8ad7088960f30a"} Nov 03 19:51:03.473276 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:03.473253 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:51:03.572655 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:03.572620 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:51:03.598320 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:03.598291 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:04.328388 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.328358 5024 scope.go:122] "RemoveContainer" containerID="28650fbfa687cac778ca739c8275e54469956c0652d78bc5661b25c08e5b40fd" Nov 03 19:51:04.461474 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.461448 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 19:51:04.461816 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.461641 5024 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 19:51:04.462372 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.462354 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" event={"ID":"c76f66cb-43f9-4ce9-8ce4-04f241205199","Type":"ContainerStarted","Data":"31cbe497775f4166d946dd20285a5f5049f3b63a5ef4ac13768cf0bae3990340"} Nov 03 19:51:04.463318 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.463302 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:51:04.464003 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.463985 5024 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-7bmz4 container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.21:8443/readyz\": dial tcp 10.132.0.21:8443: connect: connection refused" start-of-body= Nov 03 19:51:04.464038 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.464023 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" podUID="c76f66cb-43f9-4ce9-8ce4-04f241205199" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.21:8443/readyz\": dial tcp 10.132.0.21:8443: connect: connection refused" Nov 03 19:51:04.477616 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.477584 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:04.701848 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.701813 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:04.915652 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:04.915629 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:05.102021 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:05.101952 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:05.405236 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:05.405204 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:05.467335 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:05.467292 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dhz4z" event={"ID":"a4e24f1a-23f6-4ee9-84fd-0aa6313ce76f","Type":"ContainerStarted","Data":"dd4beabccbfae562315843541a977ed28aabfbff16ed7b6b665fdaa6bece1e3b"} Nov 03 19:51:05.471415 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:05.471387 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-7bmz4" Nov 03 19:51:05.693870 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:05.693788 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:05.925701 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:05.925670 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:06.273831 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.273801 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:06.290379 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.290351 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xgbcv" Nov 03 19:51:06.302043 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.302017 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:51:06.302204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.302128 5024 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 03 19:51:06.303271 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.303252 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85d7978dc5-vflbf" Nov 03 19:51:06.497398 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.497373 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:06.709728 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.709697 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:06.915385 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:06.915347 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:07.212947 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:07.212891 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:07.474203 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:07.474054 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:07.569225 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:07.569194 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:51:07.697832 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:07.697799 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:08.338824 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.338796 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7467cc6f4d-k57z9"] Nov 03 19:51:08.339025 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:08.339004 5024 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" podUID="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" Nov 03 19:51:08.478405 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.478378 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:51:08.484175 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.484156 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:51:08.544330 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544291 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:08.544330 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544333 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:08.544573 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544372 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:08.544573 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544558 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:08.544677 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544598 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:08.544677 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544644 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:08.544788 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544678 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:08.544846 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.544800 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:51:08.545105 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.545069 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:51:08.545226 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.545139 5024 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-trusted-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:08.545226 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.545169 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:51:08.547089 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.547063 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:51:08.547342 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.547325 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:51:08.547408 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.547353 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:51:08.547467 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.547415 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "kube-api-access-tzbw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:51:08.629735 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.629644 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:08.645782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.645742 5024 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-bound-sa-token\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:08.645782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.645778 5024 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-certificates\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:08.645782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.645789 5024 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-ca-trust-extracted\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:08.645999 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.645797 5024 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-installation-pull-secrets\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:08.645999 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.645806 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzbw4\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-kube-api-access-tzbw4\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:08.645999 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.645815 5024 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-image-registry-private-configuration\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:08.894084 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:08.894043 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:09.089089 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.089049 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:09.252106 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.252038 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:09.252106 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.252069 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:51:09.254573 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.254545 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"image-registry-7467cc6f4d-k57z9\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:51:09.254691 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.254547 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"image-registry-65fbcd98c7-5nj47\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:09.280309 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.280269 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:09.347661 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.347634 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:09.352732 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.352694 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") pod \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\" (UID: \"0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe\") " Nov 03 19:51:09.354676 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.354649 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls" pod "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" (UID: "0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:51:09.453872 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.453846 5024 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe-registry-tls\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:09.481536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.481514 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7467cc6f4d-k57z9" Nov 03 19:51:09.715154 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.715124 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7467cc6f4d-k57z9"] Nov 03 19:51:09.722755 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.722729 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7467cc6f4d-k57z9"] Nov 03 19:51:09.823314 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:09.823291 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fbcd98c7-5nj47"] Nov 03 19:51:09.826241 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:51:09.826218 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb450369_6fdb_4f91_82ac_e6ea5b974551.slice/crio-a6496952323dc52f92483e4602eca0f1f5f27e05ccf85843a18c6d0cf8a87733 WatchSource:0}: Error finding container a6496952323dc52f92483e4602eca0f1f5f27e05ccf85843a18c6d0cf8a87733: Status 404 returned error can't find the container with id a6496952323dc52f92483e4602eca0f1f5f27e05ccf85843a18c6d0cf8a87733 Nov 03 19:51:10.333144 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:10.333104 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe" path="/var/lib/kubelet/pods/0e3fe5bf-e0ae-4c5c-9a9e-d994515485fe/volumes" Nov 03 19:51:10.487258 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:10.487227 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" event={"ID":"eb450369-6fdb-4f91-82ac-e6ea5b974551","Type":"ContainerStarted","Data":"5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5"} Nov 03 19:51:10.487422 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:10.487272 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" event={"ID":"eb450369-6fdb-4f91-82ac-e6ea5b974551","Type":"ContainerStarted","Data":"a6496952323dc52f92483e4602eca0f1f5f27e05ccf85843a18c6d0cf8a87733"} Nov 03 19:51:10.487422 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:10.487352 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:11.449745 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:11.449720 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hsxlr" Nov 03 19:51:13.551070 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:13.551040 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:13.732875 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:13.732836 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:13.924316 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:13.924287 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:14.104269 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:14.104235 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:14.728921 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:14.728893 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:15.857185 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:15.857154 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:16.078345 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:16.078316 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:18.899123 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:18.899075 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:19.153410 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.153335 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:19.335344 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.335316 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:19.524694 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.524623 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:19.653122 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.653086 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-t69kp"] Nov 03 19:51:19.702736 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.702709 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.710564 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.710537 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:19.758827 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.758799 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 03 19:51:19.804694 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.804640 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 03 19:51:19.804809 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.804779 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 03 19:51:19.804854 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.804820 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 03 19:51:19.804886 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.804876 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qfjjk\"" Nov 03 19:51:19.830346 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830324 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830454 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830353 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-wtmp\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830454 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830374 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830569 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830469 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-tls\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830569 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830494 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-sys\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830569 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830542 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv46q\" (UniqueName: \"kubernetes.io/projected/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-kube-api-access-tv46q\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830689 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830620 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-root\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830689 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830639 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-textfile\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.830689 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.830654 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-metrics-client-ca\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.891609 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.891588 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:19.931493 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931467 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-textfile\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931504 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-metrics-client-ca\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931538 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931561 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-wtmp\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931579 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931611 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-tls\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931635 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-sys\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931652 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv46q\" (UniqueName: \"kubernetes.io/projected/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-kube-api-access-tv46q\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931680 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-root\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931742 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-root\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.931874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.931778 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-textfile\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.932398 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.932180 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-sys\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.932398 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.932240 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.932398 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.932312 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-wtmp\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.932740 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.932720 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-metrics-client-ca\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.934267 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.934240 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.934429 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.934407 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-node-exporter-tls\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:19.993743 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:19.993717 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv46q\" (UniqueName: \"kubernetes.io/projected/aa187bc7-e39b-4361-9bc4-e484ab7ef1a7-kube-api-access-tv46q\") pod \"node-exporter-t69kp\" (UID: \"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7\") " pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:20.054366 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:20.054342 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-t69kp" Nov 03 19:51:20.085907 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:51:20.085885 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa187bc7_e39b_4361_9bc4_e484ab7ef1a7.slice/crio-8a30cad082b3a062d81fb81334d46bc29392904677bb5386fcd8e4174460821b WatchSource:0}: Error finding container 8a30cad082b3a062d81fb81334d46bc29392904677bb5386fcd8e4174460821b: Status 404 returned error can't find the container with id 8a30cad082b3a062d81fb81334d46bc29392904677bb5386fcd8e4174460821b Nov 03 19:51:20.125500 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:20.125479 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:20.304727 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:20.304700 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:20.359313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:20.359252 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-25m4r" Nov 03 19:51:20.522565 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:20.522532 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t69kp" event={"ID":"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7","Type":"ContainerStarted","Data":"8a30cad082b3a062d81fb81334d46bc29392904677bb5386fcd8e4174460821b"} Nov 03 19:51:20.918627 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:20.918598 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:21.122165 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:21.122133 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:21.306061 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:21.305992 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:21.795522 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:21.795488 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:22.135178 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:22.135114 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:22.339474 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:22.339448 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:22.526688 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:22.526662 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:22.532214 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:22.532194 5024 generic.go:356] "Generic (PLEG): container finished" podID="aa187bc7-e39b-4361-9bc4-e484ab7ef1a7" containerID="41e4b88d88da3097bd5589d2f580d71a61776240ddef1ea01987444850cfbe30" exitCode=0 Nov 03 19:51:22.532324 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:22.532226 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t69kp" event={"ID":"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7","Type":"ContainerDied","Data":"41e4b88d88da3097bd5589d2f580d71a61776240ddef1ea01987444850cfbe30"} Nov 03 19:51:23.538332 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:23.538298 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t69kp" event={"ID":"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7","Type":"ContainerStarted","Data":"1b315b9f338a1f5a135b8d7673309b4963ddd08711c23089a2de6d52cd423fd6"} Nov 03 19:51:23.538688 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:23.538362 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-t69kp" event={"ID":"aa187bc7-e39b-4361-9bc4-e484ab7ef1a7","Type":"ContainerStarted","Data":"1dcd1e2e8dc321d4943c3425aa4b9adcfce451a135aaf89f3097c42af10d7670"} Nov 03 19:51:23.707177 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:23.707123 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-t69kp" podStartSLOduration=2.8690479829999997 podStartE2EDuration="4.707109788s" totalImagesPullingTime="1.75418177s" totalInitContainerRuntime="83.880035ms" isStatefulPod=true podCreationTimestamp="2026-11-03 19:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:51:23.706151995 +0000 UTC m=+31.487868677" watchObservedRunningTime="2026-11-03 19:51:23.707109788 +0000 UTC m=+31.488826448" Nov 03 19:51:23.720574 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:23.720547 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:23.895678 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:23.895651 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:24.070498 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:24.070472 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:24.248736 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:24.248656 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:24.437645 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:24.437613 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:25.584268 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:25.584240 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rnq79" Nov 03 19:51:28.711603 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:28.711563 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:31.494810 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:31.494784 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:31.580515 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:31.580483 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fbcd98c7-5nj47"] Nov 03 19:51:31.683374 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:31.683342 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:32.043829 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:32.043799 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:32.222565 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:32.222465 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:34.478673 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:34.478642 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:34.664882 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:34.664851 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:36.083871 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:36.083837 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:36.268321 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:36.268289 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:36.468388 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:36.468347 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:37.082843 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:37.082795 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:37.284168 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:37.284140 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:37.570715 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:37.570675 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:51:37.750467 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:37.750424 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:37.965501 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:37.965465 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:40.585970 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:40.585914 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:40.771830 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:40.771799 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:41.625195 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:41.625144 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:41.848841 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:41.848794 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:42.496463 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:42.496430 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:42.684975 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:42.684948 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:50.518701 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:50.518666 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:50.698649 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:50.698615 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:52.085686 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:52.085647 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:52.260590 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:52.260542 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:52.449103 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:52.449063 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:53.405358 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:53.405332 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:53.604537 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:53.604501 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:54.012071 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:54.012005 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:54.197418 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:54.197389 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:51:56.600342 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.600277 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" podUID="eb450369-6fdb-4f91-82ac-e6ea5b974551" containerName="registry" containerID="cri-o://5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5" gracePeriod=30 Nov 03 19:51:56.844611 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.844583 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:56.917024 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.916990 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917024 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917029 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917057 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917088 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917108 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917133 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917159 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917239 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\") pod \"eb450369-6fdb-4f91-82ac-e6ea5b974551\" (UID: \"eb450369-6fdb-4f91-82ac-e6ea5b974551\") " Nov 03 19:51:56.917648 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917616 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:51:56.917851 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.917796 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:51:56.920408 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.920372 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:51:56.920514 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.920423 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:51:56.920514 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.920443 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 19:51:56.920514 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.920494 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:51:56.920615 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.920511 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "kube-api-access-46n9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:51:56.924415 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:56.924392 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted" pod "eb450369-6fdb-4f91-82ac-e6ea5b974551" (UID: "eb450369-6fdb-4f91-82ac-e6ea5b974551"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:51:57.018209 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018181 5024 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-trusted-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.018209 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018209 5024 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/eb450369-6fdb-4f91-82ac-e6ea5b974551-ca-trust-extracted\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.018423 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018220 5024 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-bound-sa-token\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.018423 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018229 5024 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-installation-pull-secrets\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.018423 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018240 5024 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-certificates\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.018423 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018249 5024 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/eb450369-6fdb-4f91-82ac-e6ea5b974551-image-registry-private-configuration\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.018423 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018257 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46n9z\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-kube-api-access-46n9z\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.018423 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.018266 5024 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/eb450369-6fdb-4f91-82ac-e6ea5b974551-registry-tls\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:51:57.668497 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.668465 5024 generic.go:356] "Generic (PLEG): container finished" podID="eb450369-6fdb-4f91-82ac-e6ea5b974551" containerID="5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5" exitCode=0 Nov 03 19:51:57.669008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.668510 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" Nov 03 19:51:57.669008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.668531 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" event={"ID":"eb450369-6fdb-4f91-82ac-e6ea5b974551","Type":"ContainerDied","Data":"5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5"} Nov 03 19:51:57.669008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.668571 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fbcd98c7-5nj47" event={"ID":"eb450369-6fdb-4f91-82ac-e6ea5b974551","Type":"ContainerDied","Data":"a6496952323dc52f92483e4602eca0f1f5f27e05ccf85843a18c6d0cf8a87733"} Nov 03 19:51:57.669008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.668591 5024 scope.go:122] "RemoveContainer" containerID="5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5" Nov 03 19:51:57.677469 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.677447 5024 scope.go:122] "RemoveContainer" containerID="5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5" Nov 03 19:51:57.677736 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:51:57.677713 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5\": container with ID starting with 5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5 not found: ID does not exist" containerID="5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5" Nov 03 19:51:57.677797 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.677744 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5"} err="failed to get container status \"5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5\": rpc error: code = NotFound desc = could not find container \"5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5\": container with ID starting with 5af4127ab958a1cbaa3398ce57add445ec5564819739a129524f2c49ca9e02f5 not found: ID does not exist" Nov 03 19:51:57.881338 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.881304 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fbcd98c7-5nj47"] Nov 03 19:51:57.931138 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:57.931064 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65fbcd98c7-5nj47"] Nov 03 19:51:58.333497 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:51:58.333429 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eb450369-6fdb-4f91-82ac-e6ea5b974551" path="/var/lib/kubelet/pods/eb450369-6fdb-4f91-82ac-e6ea5b974551/volumes" Nov 03 19:52:06.379840 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:06.379804 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:06.555951 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:06.555877 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:07.082312 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:07.082273 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:07.264390 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:07.264354 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:07.570983 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:52:07.570949 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:52:07.973531 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:07.973491 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:08.168389 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:08.168347 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:11.451217 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:11.451180 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:15.014565 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:15.014535 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:15.193444 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:15.193398 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:17.744863 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:17.744829 5024 generic.go:356] "Generic (PLEG): container finished" podID="852d63c2-7941-4726-8d8b-2a1aad748f1a" containerID="2f7fd2655ae425a3965d1a745117fba23f8f85d4645cf47704403290cf698b91" exitCode=0 Nov 03 19:52:17.745257 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:17.744902 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" event={"ID":"852d63c2-7941-4726-8d8b-2a1aad748f1a","Type":"ContainerDied","Data":"2f7fd2655ae425a3965d1a745117fba23f8f85d4645cf47704403290cf698b91"} Nov 03 19:52:18.893000 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.892973 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:52:18.987162 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.987132 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\") pod \"852d63c2-7941-4726-8d8b-2a1aad748f1a\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " Nov 03 19:52:18.987351 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.987182 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\") pod \"852d63c2-7941-4726-8d8b-2a1aad748f1a\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " Nov 03 19:52:18.987351 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.987233 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\") pod \"852d63c2-7941-4726-8d8b-2a1aad748f1a\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " Nov 03 19:52:18.987351 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.987272 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\" (UniqueName: \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\") pod \"852d63c2-7941-4726-8d8b-2a1aad748f1a\" (UID: \"852d63c2-7941-4726-8d8b-2a1aad748f1a\") " Nov 03 19:52:18.987499 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.987454 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path" pod "852d63c2-7941-4726-8d8b-2a1aad748f1a" (UID: "852d63c2-7941-4726-8d8b-2a1aad748f1a"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:52:18.987599 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.987575 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle" pod "852d63c2-7941-4726-8d8b-2a1aad748f1a" (UID: "852d63c2-7941-4726-8d8b-2a1aad748f1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:52:18.987667 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.987640 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle" pod "852d63c2-7941-4726-8d8b-2a1aad748f1a" (UID: "852d63c2-7941-4726-8d8b-2a1aad748f1a"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:52:18.989732 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:18.989711 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9" pod "852d63c2-7941-4726-8d8b-2a1aad748f1a" (UID: "852d63c2-7941-4726-8d8b-2a1aad748f1a"). InnerVolumeSpecName "kube-api-access-dkbn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:52:19.088178 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:19.088115 5024 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/852d63c2-7941-4726-8d8b-2a1aad748f1a-archives-path\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:52:19.088178 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:19.088139 5024 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-trusted-ca-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:52:19.088178 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:19.088148 5024 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852d63c2-7941-4726-8d8b-2a1aad748f1a-service-ca-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:52:19.088178 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:19.088157 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkbn9\" (UniqueName: \"kubernetes.io/projected/852d63c2-7941-4726-8d8b-2a1aad748f1a-kube-api-access-dkbn9\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:52:19.754263 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:19.754230 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" event={"ID":"852d63c2-7941-4726-8d8b-2a1aad748f1a","Type":"ContainerDied","Data":"471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f"} Nov 03 19:52:19.754430 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:19.754283 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="471f89cb5035fd0997cc32c7677957b17f3b3c60eaa138998f7072cfd1589d1f" Nov 03 19:52:19.754430 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:19.754245 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-p7nwb-5jxp7" Nov 03 19:52:22.254221 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.254196 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:22.439267 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.439233 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:22.766623 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.766548 5024 generic.go:356] "Generic (PLEG): container finished" podID="0541c396-e42d-45e3-abe6-70b647e84341" containerID="067511dede6df3d077ae04943e82a2931eddad6e360be00b839ac26d4eb91ef6" exitCode=0 Nov 03 19:52:22.766769 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.766620 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" event={"ID":"0541c396-e42d-45e3-abe6-70b647e84341","Type":"ContainerDied","Data":"067511dede6df3d077ae04943e82a2931eddad6e360be00b839ac26d4eb91ef6"} Nov 03 19:52:22.766986 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.766968 5024 scope.go:122] "RemoveContainer" containerID="067511dede6df3d077ae04943e82a2931eddad6e360be00b839ac26d4eb91ef6" Nov 03 19:52:22.768006 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.767982 5024 generic.go:356] "Generic (PLEG): container finished" podID="d13c24d6-6885-4eb9-952c-1c366b8d775b" containerID="328de065d3932a3100261b84ff617ff7cb320e27ef8b134104f97e514f5abfe9" exitCode=0 Nov 03 19:52:22.768109 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.768056 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" event={"ID":"d13c24d6-6885-4eb9-952c-1c366b8d775b","Type":"ContainerDied","Data":"328de065d3932a3100261b84ff617ff7cb320e27ef8b134104f97e514f5abfe9"} Nov 03 19:52:22.768323 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:22.768310 5024 scope.go:122] "RemoveContainer" containerID="328de065d3932a3100261b84ff617ff7cb320e27ef8b134104f97e514f5abfe9" Nov 03 19:52:23.043408 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:23.043320 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:23.774122 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:23.774088 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mr5f4" event={"ID":"0541c396-e42d-45e3-abe6-70b647e84341","Type":"ContainerStarted","Data":"da11b4be747588cf8d0fb64c7f74885c4d2a9d513a9863ff108c177b3dfb1b5f"} Nov 03 19:52:23.776544 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:23.776513 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bxcw2" event={"ID":"d13c24d6-6885-4eb9-952c-1c366b8d775b","Type":"ContainerStarted","Data":"8a5cc371b8a27f3fc3b088ca0713706a8bd27cac69cfe42d53aeec3148cd88c2"} Nov 03 19:52:26.789389 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:26.789309 5024 generic.go:356] "Generic (PLEG): container finished" podID="811da5af-e26c-482c-99c3-14202b7d524e" containerID="f5d0c20ab6a8e71d6391af02325f666697dc9a4242c013d36f206162b9ab0737" exitCode=0 Nov 03 19:52:26.789389 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:26.789342 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5tccb" event={"ID":"811da5af-e26c-482c-99c3-14202b7d524e","Type":"ContainerDied","Data":"f5d0c20ab6a8e71d6391af02325f666697dc9a4242c013d36f206162b9ab0737"} Nov 03 19:52:26.789755 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:26.789622 5024 scope.go:122] "RemoveContainer" containerID="f5d0c20ab6a8e71d6391af02325f666697dc9a4242c013d36f206162b9ab0737" Nov 03 19:52:27.795031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:27.795002 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-5tccb" event={"ID":"811da5af-e26c-482c-99c3-14202b7d524e","Type":"ContainerStarted","Data":"81fda47214b63fa7c4cf1620665e869eb20f448e981280b88cf3db9a65887351"} Nov 03 19:52:37.570372 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:52:37.570335 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:52:41.086468 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:41.086428 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:41.256743 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:41.256715 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:41.966673 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:41.966623 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:43.369655 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:43.369607 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:43.553483 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:43.553432 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:43.744451 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:43.744420 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:43.917640 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:43.917616 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:53.790586 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:53.790536 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:53.969553 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:53.969513 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:56.502163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:56.502134 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:52:56.677361 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:52:56.677329 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:53:07.080206 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:53:07.080120 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:53:07.259023 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:53:07.258987 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:53:07.569817 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:53:07.569784 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:53:37.569806 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:53:37.569771 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:53:42.327419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:53:42.327386 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:54:07.569466 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:54:07.569430 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:54:37.571544 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:54:37.571463 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:54:42.656958 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:54:42.656898 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:07.570426 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:55:07.570386 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:55:11.650021 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:11.649985 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:11.845204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:11.845170 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:13.119232 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.119196 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:13.362062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.362031 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:13.829610 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.829570 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl"] Nov 03 19:55:13.829862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.829851 5024 cpu_manager.go:414] "containerMap: removing container" podUID="852d63c2-7941-4726-8d8b-2a1aad748f1a" containerName="insights-gathering" Nov 03 19:55:13.829908 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.829864 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="852d63c2-7941-4726-8d8b-2a1aad748f1a" containerName="insights-gathering" Nov 03 19:55:13.829908 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.829895 5024 cpu_manager.go:414] "containerMap: removing container" podUID="eb450369-6fdb-4f91-82ac-e6ea5b974551" containerName="registry" Nov 03 19:55:13.829908 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.829900 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb450369-6fdb-4f91-82ac-e6ea5b974551" containerName="registry" Nov 03 19:55:13.830031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.829975 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb450369-6fdb-4f91-82ac-e6ea5b974551" containerName="registry" Nov 03 19:55:13.830031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.829986 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="852d63c2-7941-4726-8d8b-2a1aad748f1a" containerName="insights-gathering" Nov 03 19:55:13.832913 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.832898 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:13.934865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.934830 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-qdv5v\"" Nov 03 19:55:13.934865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.934840 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 19:55:13.935084 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.934840 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 19:55:13.935898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.935880 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl"] Nov 03 19:55:13.941218 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.941196 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:13.941492 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.941232 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc9jr\" (UniqueName: \"kubernetes.io/projected/a6758311-0206-4b99-9cf6-1ca530fce6b7-kube-api-access-jc9jr\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:13.941492 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:13.941257 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.042579 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.042537 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.042765 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.042603 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.042765 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.042634 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc9jr\" (UniqueName: \"kubernetes.io/projected/a6758311-0206-4b99-9cf6-1ca530fce6b7-kube-api-access-jc9jr\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.042973 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.042951 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.043013 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.042968 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.103519 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.103441 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc9jr\" (UniqueName: \"kubernetes.io/projected/a6758311-0206-4b99-9cf6-1ca530fce6b7-kube-api-access-jc9jr\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.147784 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.147747 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:55:14.294899 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.294865 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645"] Nov 03 19:55:14.298441 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.298425 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.345918 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.345886 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.346106 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.345948 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.346106 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.346059 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p98vc\" (UniqueName: \"kubernetes.io/projected/c2ebc500-0cab-4261-84aa-86d33875e959-kube-api-access-p98vc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.351039 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.351019 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-mtw94\"" Nov 03 19:55:14.356331 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.356270 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645"] Nov 03 19:55:14.388937 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.388906 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4"] Nov 03 19:55:14.392174 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.392155 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.447163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.447130 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.447163 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.447167 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxcvw\" (UniqueName: \"kubernetes.io/projected/29e80428-c490-463e-b86f-7194b02c57aa-kube-api-access-pxcvw\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.447357 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.447197 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.447357 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.447308 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p98vc\" (UniqueName: \"kubernetes.io/projected/c2ebc500-0cab-4261-84aa-86d33875e959-kube-api-access-p98vc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.447357 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.447340 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.447465 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.447414 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.447557 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.447544 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.449468 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.448042 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.451147 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.451014 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-vvlbj\"" Nov 03 19:55:14.454625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.452196 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4"] Nov 03 19:55:14.487625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.487594 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd"] Nov 03 19:55:14.491078 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.491063 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.510956 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.510914 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p98vc\" (UniqueName: \"kubernetes.io/projected/c2ebc500-0cab-4261-84aa-86d33875e959-kube-api-access-p98vc\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.542970 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.542943 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-rx789\"" Nov 03 19:55:14.547995 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.547973 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qd9\" (UniqueName: \"kubernetes.io/projected/8c1cad6e-e481-492a-9644-9e6bb203a744-kube-api-access-54qd9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.548108 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.548054 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.548183 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.548159 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.548249 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.548232 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxcvw\" (UniqueName: \"kubernetes.io/projected/29e80428-c490-463e-b86f-7194b02c57aa-kube-api-access-pxcvw\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.548292 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.548269 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.548332 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.548324 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.548710 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.548692 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.548810 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.548710 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.549049 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.549033 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl"] Nov 03 19:55:14.552512 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:14.552478 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6758311_0206_4b99_9cf6_1ca530fce6b7.slice/crio-87bc09fab22d7a642522bfdd18a0da069e18b050bf41af605bc3146ce78d5095 WatchSource:0}: Error finding container 87bc09fab22d7a642522bfdd18a0da069e18b050bf41af605bc3146ce78d5095: Status 404 returned error can't find the container with id 87bc09fab22d7a642522bfdd18a0da069e18b050bf41af605bc3146ce78d5095 Nov 03 19:55:14.553202 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.553181 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd"] Nov 03 19:55:14.591157 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.591131 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf"] Nov 03 19:55:14.594744 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.594728 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.609032 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.608919 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxcvw\" (UniqueName: \"kubernetes.io/projected/29e80428-c490-463e-b86f-7194b02c57aa-kube-api-access-pxcvw\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.614286 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.614271 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:14.647126 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.647098 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-jwpmj\"" Nov 03 19:55:14.649431 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649407 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.649563 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649451 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qd9\" (UniqueName: \"kubernetes.io/projected/8c1cad6e-e481-492a-9644-9e6bb203a744-kube-api-access-54qd9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.649563 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649473 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.649563 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649530 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.649719 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649567 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.649719 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649671 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lndxk\" (UniqueName: \"kubernetes.io/projected/3f77eada-b1eb-41fd-a667-e4a638454b26-kube-api-access-lndxk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.649967 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649950 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.650041 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.649972 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.655392 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.655367 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf"] Nov 03 19:55:14.708140 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.708116 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:14.710590 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.710567 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qd9\" (UniqueName: \"kubernetes.io/projected/8c1cad6e-e481-492a-9644-9e6bb203a744-kube-api-access-54qd9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.751129 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.751098 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lndxk\" (UniqueName: \"kubernetes.io/projected/3f77eada-b1eb-41fd-a667-e4a638454b26-kube-api-access-lndxk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.751285 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.751151 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.751285 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.751192 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.751661 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.751638 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.751705 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.751649 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.806630 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.806598 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:14.812560 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.812532 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lndxk\" (UniqueName: \"kubernetes.io/projected/3f77eada-b1eb-41fd-a667-e4a638454b26-kube-api-access-lndxk\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.910243 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.910211 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:55:14.986994 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:14.986971 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645"] Nov 03 19:55:14.989493 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:14.989469 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ebc500_0cab_4261_84aa_86d33875e959.slice/crio-64c90af8a2f8a526e607a5e82117d443e59bdd1db705e47ffd83a61019dbd938 WatchSource:0}: Error finding container 64c90af8a2f8a526e607a5e82117d443e59bdd1db705e47ffd83a61019dbd938: Status 404 returned error can't find the container with id 64c90af8a2f8a526e607a5e82117d443e59bdd1db705e47ffd83a61019dbd938 Nov 03 19:55:15.079041 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.079013 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4"] Nov 03 19:55:15.081638 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:15.081601 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29e80428_c490_463e_b86f_7194b02c57aa.slice/crio-97677a7980aec92061c9e611b8c5207e5ae54cc2b467892577dc16ad55bcd7a9 WatchSource:0}: Error finding container 97677a7980aec92061c9e611b8c5207e5ae54cc2b467892577dc16ad55bcd7a9: Status 404 returned error can't find the container with id 97677a7980aec92061c9e611b8c5207e5ae54cc2b467892577dc16ad55bcd7a9 Nov 03 19:55:15.174832 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.174452 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd"] Nov 03 19:55:15.177134 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:15.177102 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1cad6e_e481_492a_9644_9e6bb203a744.slice/crio-cc4fa83233319fba426e20011bc4d5ebfb543e77daa89b18fc5b407185293919 WatchSource:0}: Error finding container cc4fa83233319fba426e20011bc4d5ebfb543e77daa89b18fc5b407185293919: Status 404 returned error can't find the container with id cc4fa83233319fba426e20011bc4d5ebfb543e77daa89b18fc5b407185293919 Nov 03 19:55:15.277891 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.277858 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf"] Nov 03 19:55:15.281351 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:15.281324 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f77eada_b1eb_41fd_a667_e4a638454b26.slice/crio-8f5e37137cfdd1d986b3e59d24015305509f2beb2f0da319500d9433103b5510 WatchSource:0}: Error finding container 8f5e37137cfdd1d986b3e59d24015305509f2beb2f0da319500d9433103b5510: Status 404 returned error can't find the container with id 8f5e37137cfdd1d986b3e59d24015305509f2beb2f0da319500d9433103b5510 Nov 03 19:55:15.351238 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.351210 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:15.413350 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.413319 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d"] Nov 03 19:55:15.417025 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.417006 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.428889 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.428855 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" event={"ID":"8c1cad6e-e481-492a-9644-9e6bb203a744","Type":"ContainerStarted","Data":"cc4fa83233319fba426e20011bc4d5ebfb543e77daa89b18fc5b407185293919"} Nov 03 19:55:15.430396 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.430352 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" event={"ID":"c2ebc500-0cab-4261-84aa-86d33875e959","Type":"ContainerStarted","Data":"64c90af8a2f8a526e607a5e82117d443e59bdd1db705e47ffd83a61019dbd938"} Nov 03 19:55:15.431641 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.431599 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" event={"ID":"29e80428-c490-463e-b86f-7194b02c57aa","Type":"ContainerStarted","Data":"97677a7980aec92061c9e611b8c5207e5ae54cc2b467892577dc16ad55bcd7a9"} Nov 03 19:55:15.432724 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.432701 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" event={"ID":"3f77eada-b1eb-41fd-a667-e4a638454b26","Type":"ContainerStarted","Data":"8f5e37137cfdd1d986b3e59d24015305509f2beb2f0da319500d9433103b5510"} Nov 03 19:55:15.433959 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.433920 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" event={"ID":"a6758311-0206-4b99-9cf6-1ca530fce6b7","Type":"ContainerStarted","Data":"87bc09fab22d7a642522bfdd18a0da069e18b050bf41af605bc3146ce78d5095"} Nov 03 19:55:15.455637 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.455605 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqpvx\" (UniqueName: \"kubernetes.io/projected/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-kube-api-access-nqpvx\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.455736 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.455695 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.455847 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.455746 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.470850 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.469235 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-vrdz8\"" Nov 03 19:55:15.476766 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.474813 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d"] Nov 03 19:55:15.556978 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.556943 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqpvx\" (UniqueName: \"kubernetes.io/projected/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-kube-api-access-nqpvx\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.557134 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.556990 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.557134 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.557030 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.557442 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.557421 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.557501 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.557458 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.618881 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.618852 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqpvx\" (UniqueName: \"kubernetes.io/projected/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-kube-api-access-nqpvx\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:15.736137 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:15.736063 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:16.129834 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:16.129620 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d"] Nov 03 19:55:16.142624 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:16.142595 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b42b969_1a97_46a9_a2c7_cf24fddebfe5.slice/crio-0f3336aac3d186370033ab41539f98353537d11655489063ec5a1cc1ae02c7ee WatchSource:0}: Error finding container 0f3336aac3d186370033ab41539f98353537d11655489063ec5a1cc1ae02c7ee: Status 404 returned error can't find the container with id 0f3336aac3d186370033ab41539f98353537d11655489063ec5a1cc1ae02c7ee Nov 03 19:55:16.446374 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:16.446337 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" event={"ID":"8b42b969-1a97-46a9-a2c7-cf24fddebfe5","Type":"ContainerStarted","Data":"0f3336aac3d186370033ab41539f98353537d11655489063ec5a1cc1ae02c7ee"} Nov 03 19:55:18.254702 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.252556 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn"] Nov 03 19:55:18.257987 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.256806 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.360459 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.360417 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn"] Nov 03 19:55:18.360632 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.360571 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-8fchc\"" Nov 03 19:55:18.385552 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.385517 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.385705 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.385604 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.385705 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.385636 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l957\" (UniqueName: \"kubernetes.io/projected/1f157c2b-0872-44d7-8221-8ef7ff76692b-kube-api-access-9l957\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.486842 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.486809 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.487047 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.486872 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l957\" (UniqueName: \"kubernetes.io/projected/1f157c2b-0872-44d7-8221-8ef7ff76692b-kube-api-access-9l957\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.487047 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.486922 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.487395 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.487374 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.487648 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.487604 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.563064 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.562986 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l957\" (UniqueName: \"kubernetes.io/projected/1f157c2b-0872-44d7-8221-8ef7ff76692b-kube-api-access-9l957\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.587313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.587283 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:55:18.999056 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:18.999022 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn"] Nov 03 19:55:19.008918 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:19.008885 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f157c2b_0872_44d7_8221_8ef7ff76692b.slice/crio-efc6276e96533b6e73e9b2440fdbf6993f46db5d8dda7da43cf202911a5f46d0 WatchSource:0}: Error finding container efc6276e96533b6e73e9b2440fdbf6993f46db5d8dda7da43cf202911a5f46d0: Status 404 returned error can't find the container with id efc6276e96533b6e73e9b2440fdbf6993f46db5d8dda7da43cf202911a5f46d0 Nov 03 19:55:19.468722 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:19.468682 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" event={"ID":"1f157c2b-0872-44d7-8221-8ef7ff76692b","Type":"ContainerStarted","Data":"efc6276e96533b6e73e9b2440fdbf6993f46db5d8dda7da43cf202911a5f46d0"} Nov 03 19:55:20.504211 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:20.504172 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:20.703245 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:20.703211 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:21.818230 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.818183 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2"] Nov 03 19:55:21.823019 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.822986 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.876384 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.876350 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 03 19:55:21.877156 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.877133 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-g4rk2\"" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919144 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919179 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvk4m\" (UniqueName: \"kubernetes.io/projected/f6f75017-0a57-4f8c-b105-c8434fc35780-kube-api-access-kvk4m\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919207 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919236 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919252 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919274 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919303 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919334 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.919536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.919368 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6f75017-0a57-4f8c-b105-c8434fc35780-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:21.938474 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.938385 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2"] Nov 03 19:55:21.965364 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:21.965328 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:22.020372 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020338 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020545 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020385 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020545 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020420 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020545 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020453 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020545 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020506 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020762 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020547 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6f75017-0a57-4f8c-b105-c8434fc35780-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020762 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020587 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020762 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020612 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvk4m\" (UniqueName: \"kubernetes.io/projected/f6f75017-0a57-4f8c-b105-c8434fc35780-kube-api-access-kvk4m\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.020762 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.020653 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.021147 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.021125 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.021395 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.021369 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.022265 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.022243 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.022784 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.022764 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.023394 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.023368 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f6f75017-0a57-4f8c-b105-c8434fc35780-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.041138 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.041108 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.052061 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.052031 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.085739 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.085655 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6f75017-0a57-4f8c-b105-c8434fc35780-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.086315 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.086253 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvk4m\" (UniqueName: \"kubernetes.io/projected/f6f75017-0a57-4f8c-b105-c8434fc35780-kube-api-access-kvk4m\") pod \"maas-default-gateway-openshift-default-59f957fdd7-q6cx2\" (UID: \"f6f75017-0a57-4f8c-b105-c8434fc35780\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.146046 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.141920 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:22.146046 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.144406 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm"] Nov 03 19:55:22.147920 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.147859 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:22.149473 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.148534 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.192957 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.190495 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj"] Nov 03 19:55:22.212797 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.201747 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-swsdv\"" Nov 03 19:55:22.214958 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.214443 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm"] Nov 03 19:55:22.214958 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.214548 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.222483 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.222390 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.222483 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.222464 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.223898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.222552 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6q26\" (UniqueName: \"kubernetes.io/projected/771d9633-4f77-4d28-aca7-4793afd51903-kube-api-access-b6q26\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.223898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.222639 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/771d9633-4f77-4d28-aca7-4793afd51903-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.223898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.222692 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/771d9633-4f77-4d28-aca7-4793afd51903-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.223898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.222772 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.223898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.222861 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.223898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.223176 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.223898 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.223213 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/771d9633-4f77-4d28-aca7-4793afd51903-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.242961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.238787 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl"] Nov 03 19:55:22.244198 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.244174 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.250892 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.250599 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj"] Nov 03 19:55:22.273480 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.271449 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk"] Nov 03 19:55:22.276282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.275577 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.323847 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.323805 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/771d9633-4f77-4d28-aca7-4793afd51903-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.323879 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.324031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.323947 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.323976 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.324031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324011 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxlx5\" (UniqueName: \"kubernetes.io/projected/d0461249-5b9f-4ded-882c-384692be91de-kube-api-access-hxlx5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324043 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324079 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324104 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xr7s\" (UniqueName: \"kubernetes.io/projected/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-kube-api-access-2xr7s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324133 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7rl4\" (UniqueName: \"kubernetes.io/projected/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-kube-api-access-q7rl4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324165 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/771d9633-4f77-4d28-aca7-4793afd51903-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324192 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324228 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.324282 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324273 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324290 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.324659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324307 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324332 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6q26\" (UniqueName: \"kubernetes.io/projected/771d9633-4f77-4d28-aca7-4793afd51903-kube-api-access-b6q26\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324376 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/771d9633-4f77-4d28-aca7-4793afd51903-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.324659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.324392 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.325202 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.325177 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/771d9633-4f77-4d28-aca7-4793afd51903-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.325506 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.325486 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.326232 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.326206 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.326957 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.326903 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.330887 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.330860 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.331237 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.331205 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/771d9633-4f77-4d28-aca7-4793afd51903-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.332249 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.332198 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/771d9633-4f77-4d28-aca7-4793afd51903-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.342110 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.342040 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl"] Nov 03 19:55:22.352709 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.352682 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk"] Nov 03 19:55:22.356278 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.356241 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:22.394756 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.394662 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/771d9633-4f77-4d28-aca7-4793afd51903-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.409192 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.409160 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6q26\" (UniqueName: \"kubernetes.io/projected/771d9633-4f77-4d28-aca7-4793afd51903-kube-api-access-b6q26\") pod \"openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm\" (UID: \"771d9633-4f77-4d28-aca7-4793afd51903\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425243 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425311 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425342 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425376 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxlx5\" (UniqueName: \"kubernetes.io/projected/d0461249-5b9f-4ded-882c-384692be91de-kube-api-access-hxlx5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425424 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xr7s\" (UniqueName: \"kubernetes.io/projected/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-kube-api-access-2xr7s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425449 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7rl4\" (UniqueName: \"kubernetes.io/projected/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-kube-api-access-q7rl4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425480 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425513 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.425556 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.426006 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.426308 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.426612 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.426892 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.427961 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.427771 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.430771 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.430655 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.476583 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.476270 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:22.512764 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.512714 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xr7s\" (UniqueName: \"kubernetes.io/projected/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-kube-api-access-2xr7s\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.513515 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.513303 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxlx5\" (UniqueName: \"kubernetes.io/projected/d0461249-5b9f-4ded-882c-384692be91de-kube-api-access-hxlx5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.522803 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.522756 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7rl4\" (UniqueName: \"kubernetes.io/projected/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-kube-api-access-q7rl4\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.545424 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.545194 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:55:22.580340 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.570543 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:22.598158 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.598103 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:55:22.642280 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.642253 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2"] Nov 03 19:55:22.643760 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:22.643308 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f75017_0a57_4f8c_b105_c8434fc35780.slice/crio-31d10e90fcf63051df317d259352d47b486c3de51ef7f03d8b510be878d4957c WatchSource:0}: Error finding container 31d10e90fcf63051df317d259352d47b486c3de51ef7f03d8b510be878d4957c: Status 404 returned error can't find the container with id 31d10e90fcf63051df317d259352d47b486c3de51ef7f03d8b510be878d4957c Nov 03 19:55:22.924433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:22.924399 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm"] Nov 03 19:55:22.928723 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:22.928690 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771d9633_4f77_4d28_aca7_4793afd51903.slice/crio-0472115ad9297e79f397e3e9f7b55b2272f203de4a6639f4a6a27148df1e0083 WatchSource:0}: Error finding container 0472115ad9297e79f397e3e9f7b55b2272f203de4a6639f4a6a27148df1e0083: Status 404 returned error can't find the container with id 0472115ad9297e79f397e3e9f7b55b2272f203de4a6639f4a6a27148df1e0083 Nov 03 19:55:23.012840 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.012800 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk"] Nov 03 19:55:23.017495 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.017356 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj"] Nov 03 19:55:23.065888 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.065838 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl"] Nov 03 19:55:23.075548 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:55:23.075510 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0461249_5b9f_4ded_882c_384692be91de.slice/crio-ee159d58fc0b7078d87441ef37fa28b745c7373be5649b2b9a465c7682f67551 WatchSource:0}: Error finding container ee159d58fc0b7078d87441ef37fa28b745c7373be5649b2b9a465c7682f67551: Status 404 returned error can't find the container with id ee159d58fc0b7078d87441ef37fa28b745c7373be5649b2b9a465c7682f67551 Nov 03 19:55:23.503367 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.503329 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" event={"ID":"7041ce3a-001f-4f7e-8724-f5ee2424c3b7","Type":"ContainerStarted","Data":"051caea1b7b274767d8f0e5499a098dbdf3133d1c7bb7b52c665b167bf17fdbc"} Nov 03 19:55:23.506053 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.506020 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" event={"ID":"771d9633-4f77-4d28-aca7-4793afd51903","Type":"ContainerStarted","Data":"0472115ad9297e79f397e3e9f7b55b2272f203de4a6639f4a6a27148df1e0083"} Nov 03 19:55:23.509440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.509412 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" event={"ID":"f6f75017-0a57-4f8c-b105-c8434fc35780","Type":"ContainerStarted","Data":"31d10e90fcf63051df317d259352d47b486c3de51ef7f03d8b510be878d4957c"} Nov 03 19:55:23.512198 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.512172 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" event={"ID":"d0461249-5b9f-4ded-882c-384692be91de","Type":"ContainerStarted","Data":"ee159d58fc0b7078d87441ef37fa28b745c7373be5649b2b9a465c7682f67551"} Nov 03 19:55:23.514939 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:23.514870 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" event={"ID":"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12","Type":"ContainerStarted","Data":"95e5888801c606b79fbcf60e2d22ec1a79c5abb1bd7fb9761d37955c43888c9b"} Nov 03 19:55:25.866215 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:25.866180 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:26.142272 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:26.142233 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:30.598016 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:30.597980 5024 generic.go:356] "Generic (PLEG): container finished" podID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerID="72ded445081bc5d7edec9c00474d1d8823bb7e4c29227c017ae10768430c5435" exitCode=0 Nov 03 19:55:30.598532 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:30.598076 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" event={"ID":"a6758311-0206-4b99-9cf6-1ca530fce6b7","Type":"ContainerDied","Data":"72ded445081bc5d7edec9c00474d1d8823bb7e4c29227c017ae10768430c5435"} Nov 03 19:55:31.613547 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:31.612348 5024 generic.go:356] "Generic (PLEG): container finished" podID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerID="27da06a42bf4528f0f4cc014692121c549f494be251af9388e39a209ce56633b" exitCode=0 Nov 03 19:55:31.613547 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:31.612495 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" event={"ID":"1f157c2b-0872-44d7-8221-8ef7ff76692b","Type":"ContainerDied","Data":"27da06a42bf4528f0f4cc014692121c549f494be251af9388e39a209ce56633b"} Nov 03 19:55:32.623239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:32.623204 5024 generic.go:356] "Generic (PLEG): container finished" podID="c2ebc500-0cab-4261-84aa-86d33875e959" containerID="f73e05e2b8bee43fe07abe23ae74efde30efd9b5f4aca0fa3284f6710d553171" exitCode=0 Nov 03 19:55:32.623743 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:32.623485 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" event={"ID":"c2ebc500-0cab-4261-84aa-86d33875e959","Type":"ContainerDied","Data":"f73e05e2b8bee43fe07abe23ae74efde30efd9b5f4aca0fa3284f6710d553171"} Nov 03 19:55:32.627496 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:32.627470 5024 generic.go:356] "Generic (PLEG): container finished" podID="29e80428-c490-463e-b86f-7194b02c57aa" containerID="860c69a351c305f9f40884e2f139034c1ca72f8d20258520c5133089f3a2d09f" exitCode=0 Nov 03 19:55:32.627618 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:32.627535 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" event={"ID":"29e80428-c490-463e-b86f-7194b02c57aa","Type":"ContainerDied","Data":"860c69a351c305f9f40884e2f139034c1ca72f8d20258520c5133089f3a2d09f"} Nov 03 19:55:33.646296 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:33.644835 5024 generic.go:356] "Generic (PLEG): container finished" podID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerID="fd7b468da3595917526a0661fc37457534a086b99b51a3d04481ecc5ecd7a375" exitCode=0 Nov 03 19:55:33.646296 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:33.646026 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" event={"ID":"3f77eada-b1eb-41fd-a667-e4a638454b26","Type":"ContainerDied","Data":"fd7b468da3595917526a0661fc37457534a086b99b51a3d04481ecc5ecd7a375"} Nov 03 19:55:33.652644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:33.652085 5024 generic.go:356] "Generic (PLEG): container finished" podID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerID="199305ded49f30cbb1813b4a38be9e05746b257c0a3e7904ad42f237a8a60026" exitCode=0 Nov 03 19:55:33.652644 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:33.652153 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" event={"ID":"8c1cad6e-e481-492a-9644-9e6bb203a744","Type":"ContainerDied","Data":"199305ded49f30cbb1813b4a38be9e05746b257c0a3e7904ad42f237a8a60026"} Nov 03 19:55:34.262350 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.262307 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:55:34.262468 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.262392 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:55:34.262468 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.262429 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:55:34.523469 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.523380 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:55:34.523584 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.523498 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:55:34.523584 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.523538 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:55:34.659382 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.659343 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" event={"ID":"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12","Type":"ContainerStarted","Data":"fffff6124cc0d59bfa7e3c0d30270cbead4bcbd58fdbcc9f3ad3c33598ab67bc"} Nov 03 19:55:34.662211 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.662181 5024 generic.go:356] "Generic (PLEG): container finished" podID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerID="9fda9b86b836043b63b33d01d9ec435447612d39f5932d1f417e3b74089314e3" exitCode=0 Nov 03 19:55:34.662341 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.662283 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" event={"ID":"7041ce3a-001f-4f7e-8724-f5ee2424c3b7","Type":"ContainerDied","Data":"9fda9b86b836043b63b33d01d9ec435447612d39f5932d1f417e3b74089314e3"} Nov 03 19:55:34.670057 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.669834 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" event={"ID":"c2ebc500-0cab-4261-84aa-86d33875e959","Type":"ContainerStarted","Data":"17910d44be2b6ba75b4c706ca84e0782f444b9c4a3e67e311fad43feb0655f5a"} Nov 03 19:55:34.673569 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.673543 5024 generic.go:356] "Generic (PLEG): container finished" podID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerID="b723019debac51f12c128bf76b34623ba3320c25bcdccd10d094adcde7983e7e" exitCode=0 Nov 03 19:55:34.673757 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.673618 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" event={"ID":"8b42b969-1a97-46a9-a2c7-cf24fddebfe5","Type":"ContainerDied","Data":"b723019debac51f12c128bf76b34623ba3320c25bcdccd10d094adcde7983e7e"} Nov 03 19:55:34.681032 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.679241 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" event={"ID":"771d9633-4f77-4d28-aca7-4793afd51903","Type":"ContainerStarted","Data":"a1f2dac51a875edfb28623657cdbb54659ab175bab1eebcbcc70268832bffceb"} Nov 03 19:55:34.685960 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.682565 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" event={"ID":"f6f75017-0a57-4f8c-b105-c8434fc35780","Type":"ContainerStarted","Data":"73f7590d582b1b4a453d57cc7a6e60f73510423cb877110bd547e1c86a99aa51"} Nov 03 19:55:34.687094 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.687064 5024 generic.go:356] "Generic (PLEG): container finished" podID="d0461249-5b9f-4ded-882c-384692be91de" containerID="3f9624b112aac7ffe535479b4f06ef70ec968503911399742b24f3446d2f10c9" exitCode=0 Nov 03 19:55:34.687190 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:34.687153 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" event={"ID":"d0461249-5b9f-4ded-882c-384692be91de","Type":"ContainerDied","Data":"3f9624b112aac7ffe535479b4f06ef70ec968503911399742b24f3446d2f10c9"} Nov 03 19:55:35.131782 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.131718 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podStartSLOduration=2.257397792 podStartE2EDuration="14.131697967s" totalImagesPullingTime="11.874300175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:55:35.130195512 +0000 UTC m=+282.911912179" watchObservedRunningTime="2026-11-03 19:55:35.131697967 +0000 UTC m=+282.913414642" Nov 03 19:55:35.146605 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.146575 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:35.151876 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.151845 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:35.252355 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.252275 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" podStartSLOduration=1.9245252609999999 podStartE2EDuration="13.252254445s" totalImagesPullingTime="11.327729184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:55:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:55:35.250451026 +0000 UTC m=+283.032167695" watchObservedRunningTime="2026-11-03 19:55:35.252254445 +0000 UTC m=+283.033971112" Nov 03 19:55:35.492479 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.489200 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:35.495347 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.495302 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:35.701219 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.701192 5024 generic.go:356] "Generic (PLEG): container finished" podID="c2ebc500-0cab-4261-84aa-86d33875e959" containerID="17910d44be2b6ba75b4c706ca84e0782f444b9c4a3e67e311fad43feb0655f5a" exitCode=0 Nov 03 19:55:35.701620 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.701295 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" event={"ID":"c2ebc500-0cab-4261-84aa-86d33875e959","Type":"ContainerDied","Data":"17910d44be2b6ba75b4c706ca84e0782f444b9c4a3e67e311fad43feb0655f5a"} Nov 03 19:55:35.711732 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.711495 5024 generic.go:356] "Generic (PLEG): container finished" podID="29e80428-c490-463e-b86f-7194b02c57aa" containerID="3ba8e0ebf1e4163e426e66cca0480edbd25e00a7650b32a6e1bce00732ce872b" exitCode=0 Nov 03 19:55:35.711732 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.711628 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" event={"ID":"29e80428-c490-463e-b86f-7194b02c57aa","Type":"ContainerDied","Data":"3ba8e0ebf1e4163e426e66cca0480edbd25e00a7650b32a6e1bce00732ce872b"} Nov 03 19:55:35.715217 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.715191 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" event={"ID":"3f77eada-b1eb-41fd-a667-e4a638454b26","Type":"ContainerStarted","Data":"76fe86d754a9c1845345a047b6b0695c6781d4cdfae6ba4ae45eec6ea52772d4"} Nov 03 19:55:35.718419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.718042 5024 generic.go:356] "Generic (PLEG): container finished" podID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerID="fffff6124cc0d59bfa7e3c0d30270cbead4bcbd58fdbcc9f3ad3c33598ab67bc" exitCode=0 Nov 03 19:55:35.718419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.718318 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" event={"ID":"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12","Type":"ContainerDied","Data":"fffff6124cc0d59bfa7e3c0d30270cbead4bcbd58fdbcc9f3ad3c33598ab67bc"} Nov 03 19:55:35.719441 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.719425 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:35.719514 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.719478 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:35.720727 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.720588 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm" Nov 03 19:55:35.721235 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:35.721217 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:55:36.729456 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.729416 5024 generic.go:356] "Generic (PLEG): container finished" podID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerID="bcad36c4c1549ec3dbf79d1b7c0f08f0e812a1ba44c6917555e79c3707ca6463" exitCode=0 Nov 03 19:55:36.729917 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.729514 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" event={"ID":"8c1cad6e-e481-492a-9644-9e6bb203a744","Type":"ContainerDied","Data":"bcad36c4c1549ec3dbf79d1b7c0f08f0e812a1ba44c6917555e79c3707ca6463"} Nov 03 19:55:36.732149 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.732118 5024 generic.go:356] "Generic (PLEG): container finished" podID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerID="cc2005093250f30536cb7dfc8cdec349dfe670c55c4e485fe6cc4e2e3f4f2e05" exitCode=0 Nov 03 19:55:36.732242 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.732229 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" event={"ID":"7041ce3a-001f-4f7e-8724-f5ee2424c3b7","Type":"ContainerDied","Data":"cc2005093250f30536cb7dfc8cdec349dfe670c55c4e485fe6cc4e2e3f4f2e05"} Nov 03 19:55:36.735330 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.735304 5024 generic.go:356] "Generic (PLEG): container finished" podID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerID="ad9cc229d233fa24a5b9ef1ead5eb824c905612b03c3e2f177dac27c844ff3a7" exitCode=0 Nov 03 19:55:36.735440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.735412 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" event={"ID":"8b42b969-1a97-46a9-a2c7-cf24fddebfe5","Type":"ContainerDied","Data":"ad9cc229d233fa24a5b9ef1ead5eb824c905612b03c3e2f177dac27c844ff3a7"} Nov 03 19:55:36.738207 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.738180 5024 generic.go:356] "Generic (PLEG): container finished" podID="d0461249-5b9f-4ded-882c-384692be91de" containerID="04fe5f8dd095b31962ab6942e24d9a664c5610df671e77b7416e260b2e5f19ab" exitCode=0 Nov 03 19:55:36.738325 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.738263 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" event={"ID":"d0461249-5b9f-4ded-882c-384692be91de","Type":"ContainerDied","Data":"04fe5f8dd095b31962ab6942e24d9a664c5610df671e77b7416e260b2e5f19ab"} Nov 03 19:55:36.741327 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.741302 5024 generic.go:356] "Generic (PLEG): container finished" podID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerID="76fe86d754a9c1845345a047b6b0695c6781d4cdfae6ba4ae45eec6ea52772d4" exitCode=0 Nov 03 19:55:36.741433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.741383 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" event={"ID":"3f77eada-b1eb-41fd-a667-e4a638454b26","Type":"ContainerDied","Data":"76fe86d754a9c1845345a047b6b0695c6781d4cdfae6ba4ae45eec6ea52772d4"} Nov 03 19:55:36.745865 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.745839 5024 generic.go:356] "Generic (PLEG): container finished" podID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerID="ca0742c5dafc9c271c6d5311ddc5964bdbab7757a0b193e15380078be0b82989" exitCode=0 Nov 03 19:55:36.745982 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.745909 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" event={"ID":"a6758311-0206-4b99-9cf6-1ca530fce6b7","Type":"ContainerDied","Data":"ca0742c5dafc9c271c6d5311ddc5964bdbab7757a0b193e15380078be0b82989"} Nov 03 19:55:36.750841 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.748498 5024 generic.go:356] "Generic (PLEG): container finished" podID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerID="7b6bde53cbefeeaa692c6784d40a7b9051dbbbd014f171b9ef333bf411121bd9" exitCode=0 Nov 03 19:55:36.750841 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:36.749398 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" event={"ID":"1f157c2b-0872-44d7-8221-8ef7ff76692b","Type":"ContainerDied","Data":"7b6bde53cbefeeaa692c6784d40a7b9051dbbbd014f171b9ef333bf411121bd9"} Nov 03 19:55:37.580270 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:55:37.580232 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:55:38.769756 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:38.768785 5024 generic.go:356] "Generic (PLEG): container finished" podID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerID="5512ddeb6700d37329396ecf4e4dae395d58cd7dc75a5f857fd2021015d8e539" exitCode=0 Nov 03 19:55:38.769756 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:38.768884 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" event={"ID":"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12","Type":"ContainerDied","Data":"5512ddeb6700d37329396ecf4e4dae395d58cd7dc75a5f857fd2021015d8e539"} Nov 03 19:55:43.045019 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:43.044916 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:55:52.460199 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:52.459954 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 19:55:52.469844 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:52.469329 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 19:55:52.475715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:52.475639 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:55:52.481512 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:52.481433 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 19:55:54.995355 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:54.995319 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" event={"ID":"c2ebc500-0cab-4261-84aa-86d33875e959","Type":"ContainerStarted","Data":"b9765a7199916d05327bb26e011b488d9549dfa30e54367d577e084da714dab0"} Nov 03 19:55:56.019680 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:56.019643 5024 generic.go:356] "Generic (PLEG): container finished" podID="c2ebc500-0cab-4261-84aa-86d33875e959" containerID="b9765a7199916d05327bb26e011b488d9549dfa30e54367d577e084da714dab0" exitCode=0 Nov 03 19:55:56.020208 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:56.019748 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" event={"ID":"c2ebc500-0cab-4261-84aa-86d33875e959","Type":"ContainerDied","Data":"b9765a7199916d05327bb26e011b488d9549dfa30e54367d577e084da714dab0"} Nov 03 19:55:56.025940 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:56.025896 5024 generic.go:356] "Generic (PLEG): container finished" podID="29e80428-c490-463e-b86f-7194b02c57aa" containerID="2f6316465dd579182b08a4431d4aeeddf9fc77d5c879674d2f5e3e0cd35095c4" exitCode=0 Nov 03 19:55:56.026073 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:56.025965 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" event={"ID":"29e80428-c490-463e-b86f-7194b02c57aa","Type":"ContainerDied","Data":"2f6316465dd579182b08a4431d4aeeddf9fc77d5c879674d2f5e3e0cd35095c4"} Nov 03 19:55:57.042988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.042946 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" event={"ID":"d0461249-5b9f-4ded-882c-384692be91de","Type":"ContainerStarted","Data":"30ccc5e3abc0eed8e690a2892136a64bef0d1d23991c497435c54c57f8d49e02"} Nov 03 19:55:57.174423 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.173635 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" podStartSLOduration=2.957510585 podStartE2EDuration="35.173617486s" totalImagesPullingTime="32.216106901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:55:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:55:57.171967496 +0000 UTC m=+304.953684164" watchObservedRunningTime="2026-11-03 19:55:57.173617486 +0000 UTC m=+304.955334152" Nov 03 19:55:57.247018 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.243525 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:57.273654 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.273627 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:57.304148 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.304123 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-util\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-util\") pod \"c2ebc500-0cab-4261-84aa-86d33875e959\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " Nov 03 19:55:57.304286 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.304168 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-util\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-util\") pod \"29e80428-c490-463e-b86f-7194b02c57aa\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " Nov 03 19:55:57.306024 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.306003 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-bundle\") pod \"c2ebc500-0cab-4261-84aa-86d33875e959\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " Nov 03 19:55:57.306136 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.306051 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/29e80428-c490-463e-b86f-7194b02c57aa-kube-api-access-pxcvw\" (UniqueName: \"kubernetes.io/projected/29e80428-c490-463e-b86f-7194b02c57aa-kube-api-access-pxcvw\") pod \"29e80428-c490-463e-b86f-7194b02c57aa\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " Nov 03 19:55:57.306136 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.306081 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2ebc500-0cab-4261-84aa-86d33875e959-kube-api-access-p98vc\" (UniqueName: \"kubernetes.io/projected/c2ebc500-0cab-4261-84aa-86d33875e959-kube-api-access-p98vc\") pod \"c2ebc500-0cab-4261-84aa-86d33875e959\" (UID: \"c2ebc500-0cab-4261-84aa-86d33875e959\") " Nov 03 19:55:57.306244 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.306136 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-bundle\") pod \"29e80428-c490-463e-b86f-7194b02c57aa\" (UID: \"29e80428-c490-463e-b86f-7194b02c57aa\") " Nov 03 19:55:57.306794 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.306746 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-bundle" pod "29e80428-c490-463e-b86f-7194b02c57aa" (UID: "29e80428-c490-463e-b86f-7194b02c57aa"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:57.306895 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.306875 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-bundle" pod "c2ebc500-0cab-4261-84aa-86d33875e959" (UID: "c2ebc500-0cab-4261-84aa-86d33875e959"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:57.307086 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.307069 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:57.307142 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.307093 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:57.309385 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.309358 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-util" pod "29e80428-c490-463e-b86f-7194b02c57aa" (UID: "29e80428-c490-463e-b86f-7194b02c57aa"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:57.311243 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.311213 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29e80428-c490-463e-b86f-7194b02c57aa-kube-api-access-pxcvw" pod "29e80428-c490-463e-b86f-7194b02c57aa" (UID: "29e80428-c490-463e-b86f-7194b02c57aa"). InnerVolumeSpecName "kube-api-access-pxcvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:55:57.312045 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.311944 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-util" pod "c2ebc500-0cab-4261-84aa-86d33875e959" (UID: "c2ebc500-0cab-4261-84aa-86d33875e959"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:57.312689 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.312622 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2ebc500-0cab-4261-84aa-86d33875e959-kube-api-access-p98vc" pod "c2ebc500-0cab-4261-84aa-86d33875e959" (UID: "c2ebc500-0cab-4261-84aa-86d33875e959"). InnerVolumeSpecName "kube-api-access-p98vc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:55:57.408557 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.408531 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2ebc500-0cab-4261-84aa-86d33875e959-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:57.408649 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.408560 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29e80428-c490-463e-b86f-7194b02c57aa-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:57.408649 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.408574 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxcvw\" (UniqueName: \"kubernetes.io/projected/29e80428-c490-463e-b86f-7194b02c57aa-kube-api-access-pxcvw\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:57.408649 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:57.408588 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p98vc\" (UniqueName: \"kubernetes.io/projected/c2ebc500-0cab-4261-84aa-86d33875e959-kube-api-access-p98vc\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:58.050137 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.050107 5024 generic.go:356] "Generic (PLEG): container finished" podID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerID="9a442a12496f9409d038e93e50d70d1dd3612fae0fcfe9a11e09eca8248571f5" exitCode=0 Nov 03 19:55:58.050486 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.050187 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" event={"ID":"8c1cad6e-e481-492a-9644-9e6bb203a744","Type":"ContainerDied","Data":"9a442a12496f9409d038e93e50d70d1dd3612fae0fcfe9a11e09eca8248571f5"} Nov 03 19:55:58.052812 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.052790 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" event={"ID":"7041ce3a-001f-4f7e-8724-f5ee2424c3b7","Type":"ContainerStarted","Data":"e95b60e79a763e794a06935526423b9bca2cbc6095ada12288e9bfeb4aee9ac2"} Nov 03 19:55:58.055764 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.055741 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" event={"ID":"c2ebc500-0cab-4261-84aa-86d33875e959","Type":"ContainerDied","Data":"64c90af8a2f8a526e607a5e82117d443e59bdd1db705e47ffd83a61019dbd938"} Nov 03 19:55:58.055868 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.055776 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64c90af8a2f8a526e607a5e82117d443e59bdd1db705e47ffd83a61019dbd938" Nov 03 19:55:58.055868 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.055843 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atl645" Nov 03 19:55:58.060332 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.060071 5024 generic.go:356] "Generic (PLEG): container finished" podID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerID="5758ab4bb07a62cf16a73737dc4874004e84eba0307ae1ff1549d5854708fee8" exitCode=0 Nov 03 19:55:58.060332 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.060167 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" event={"ID":"8b42b969-1a97-46a9-a2c7-cf24fddebfe5","Type":"ContainerDied","Data":"5758ab4bb07a62cf16a73737dc4874004e84eba0307ae1ff1549d5854708fee8"} Nov 03 19:55:58.065720 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.062690 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" event={"ID":"29e80428-c490-463e-b86f-7194b02c57aa","Type":"ContainerDied","Data":"97677a7980aec92061c9e611b8c5207e5ae54cc2b467892577dc16ad55bcd7a9"} Nov 03 19:55:58.065720 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.062728 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97677a7980aec92061c9e611b8c5207e5ae54cc2b467892577dc16ad55bcd7a9" Nov 03 19:55:58.065720 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.062798 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7wcnc4" Nov 03 19:55:58.067759 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.067560 5024 generic.go:356] "Generic (PLEG): container finished" podID="d0461249-5b9f-4ded-882c-384692be91de" containerID="30ccc5e3abc0eed8e690a2892136a64bef0d1d23991c497435c54c57f8d49e02" exitCode=0 Nov 03 19:55:58.067759 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.067642 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" event={"ID":"d0461249-5b9f-4ded-882c-384692be91de","Type":"ContainerDied","Data":"30ccc5e3abc0eed8e690a2892136a64bef0d1d23991c497435c54c57f8d49e02"} Nov 03 19:55:58.075048 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.074529 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" event={"ID":"3f77eada-b1eb-41fd-a667-e4a638454b26","Type":"ContainerStarted","Data":"06fc408145dac72ce5d3f0eb500d6d930138eec4c9a8f42bcdd08743791fb3f6"} Nov 03 19:55:58.076796 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.076778 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" event={"ID":"1f157c2b-0872-44d7-8221-8ef7ff76692b","Type":"ContainerStarted","Data":"b271b10e990139bc071188a0f9dd17d5680f78098fb8a53f6569d47230c41ceb"} Nov 03 19:55:58.313964 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.313832 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" podStartSLOduration=3.237178363 podStartE2EDuration="40.313815968s" totalImagesPullingTime="37.076637605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:55:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:55:58.312404885 +0000 UTC m=+306.094121551" watchObservedRunningTime="2026-11-03 19:55:58.313815968 +0000 UTC m=+306.095532776" Nov 03 19:55:58.693500 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.693449 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" podStartSLOduration=4.06251416 podStartE2EDuration="44.693433702s" totalImagesPullingTime="40.630919542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:55:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:55:58.69207872 +0000 UTC m=+306.473795385" watchObservedRunningTime="2026-11-03 19:55:58.693433702 +0000 UTC m=+306.475150368" Nov 03 19:55:58.863442 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:58.863342 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" podStartSLOduration=2.752737421 podStartE2EDuration="36.863327897s" totalImagesPullingTime="34.110590476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:55:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:55:58.86247253 +0000 UTC m=+306.644189195" watchObservedRunningTime="2026-11-03 19:55:58.863327897 +0000 UTC m=+306.645044562" Nov 03 19:55:59.083245 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.083211 5024 generic.go:356] "Generic (PLEG): container finished" podID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerID="06fc408145dac72ce5d3f0eb500d6d930138eec4c9a8f42bcdd08743791fb3f6" exitCode=0 Nov 03 19:55:59.083657 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.083290 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" event={"ID":"3f77eada-b1eb-41fd-a667-e4a638454b26","Type":"ContainerDied","Data":"06fc408145dac72ce5d3f0eb500d6d930138eec4c9a8f42bcdd08743791fb3f6"} Nov 03 19:55:59.085254 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.085230 5024 generic.go:356] "Generic (PLEG): container finished" podID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerID="130263f2b26503ba092cd6c70af02b1a77553f33ece8bd11cbc65ab2f7fc360b" exitCode=0 Nov 03 19:55:59.085355 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.085276 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" event={"ID":"a6758311-0206-4b99-9cf6-1ca530fce6b7","Type":"ContainerDied","Data":"130263f2b26503ba092cd6c70af02b1a77553f33ece8bd11cbc65ab2f7fc360b"} Nov 03 19:55:59.087268 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.087248 5024 generic.go:356] "Generic (PLEG): container finished" podID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerID="b271b10e990139bc071188a0f9dd17d5680f78098fb8a53f6569d47230c41ceb" exitCode=0 Nov 03 19:55:59.087348 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.087328 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" event={"ID":"1f157c2b-0872-44d7-8221-8ef7ff76692b","Type":"ContainerDied","Data":"b271b10e990139bc071188a0f9dd17d5680f78098fb8a53f6569d47230c41ceb"} Nov 03 19:55:59.089253 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.089234 5024 generic.go:356] "Generic (PLEG): container finished" podID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerID="48cdf7423787ac8f99d9fdda77db0b15301060ee3eef20713344e0a51e7ac5af" exitCode=0 Nov 03 19:55:59.089352 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.089307 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" event={"ID":"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12","Type":"ContainerDied","Data":"48cdf7423787ac8f99d9fdda77db0b15301060ee3eef20713344e0a51e7ac5af"} Nov 03 19:55:59.091180 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.091159 5024 generic.go:356] "Generic (PLEG): container finished" podID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerID="e95b60e79a763e794a06935526423b9bca2cbc6095ada12288e9bfeb4aee9ac2" exitCode=0 Nov 03 19:55:59.091264 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.091244 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" event={"ID":"7041ce3a-001f-4f7e-8724-f5ee2424c3b7","Type":"ContainerDied","Data":"e95b60e79a763e794a06935526423b9bca2cbc6095ada12288e9bfeb4aee9ac2"} Nov 03 19:55:59.244090 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.244067 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:55:59.247164 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.247144 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:55:59.250568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.250552 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:55:59.330160 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330137 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0461249-5b9f-4ded-882c-384692be91de-kube-api-access-hxlx5\" (UniqueName: \"kubernetes.io/projected/d0461249-5b9f-4ded-882c-384692be91de-kube-api-access-hxlx5\") pod \"d0461249-5b9f-4ded-882c-384692be91de\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " Nov 03 19:55:59.330313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330167 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-util\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-util\") pod \"d0461249-5b9f-4ded-882c-384692be91de\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " Nov 03 19:55:59.330313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330199 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8c1cad6e-e481-492a-9644-9e6bb203a744-kube-api-access-54qd9\" (UniqueName: \"kubernetes.io/projected/8c1cad6e-e481-492a-9644-9e6bb203a744-kube-api-access-54qd9\") pod \"8c1cad6e-e481-492a-9644-9e6bb203a744\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " Nov 03 19:55:59.330313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330234 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-util\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-util\") pod \"8c1cad6e-e481-492a-9644-9e6bb203a744\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " Nov 03 19:55:59.330313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330251 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-bundle\") pod \"8c1cad6e-e481-492a-9644-9e6bb203a744\" (UID: \"8c1cad6e-e481-492a-9644-9e6bb203a744\") " Nov 03 19:55:59.330313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330279 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-kube-api-access-nqpvx\" (UniqueName: \"kubernetes.io/projected/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-kube-api-access-nqpvx\") pod \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " Nov 03 19:55:59.330313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330312 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-util\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-util\") pod \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " Nov 03 19:55:59.330605 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330355 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-bundle\") pod \"d0461249-5b9f-4ded-882c-384692be91de\" (UID: \"d0461249-5b9f-4ded-882c-384692be91de\") " Nov 03 19:55:59.330605 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330416 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-bundle\") pod \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\" (UID: \"8b42b969-1a97-46a9-a2c7-cf24fddebfe5\") " Nov 03 19:55:59.330895 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.330863 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-bundle" pod "8c1cad6e-e481-492a-9644-9e6bb203a744" (UID: "8c1cad6e-e481-492a-9644-9e6bb203a744"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:59.331366 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.331346 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-bundle" pod "d0461249-5b9f-4ded-882c-384692be91de" (UID: "d0461249-5b9f-4ded-882c-384692be91de"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:59.331451 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.331365 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-bundle" pod "8b42b969-1a97-46a9-a2c7-cf24fddebfe5" (UID: "8b42b969-1a97-46a9-a2c7-cf24fddebfe5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:59.332746 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.332712 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0461249-5b9f-4ded-882c-384692be91de-kube-api-access-hxlx5" pod "d0461249-5b9f-4ded-882c-384692be91de" (UID: "d0461249-5b9f-4ded-882c-384692be91de"). InnerVolumeSpecName "kube-api-access-hxlx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:55:59.332864 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.332806 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1cad6e-e481-492a-9644-9e6bb203a744-kube-api-access-54qd9" pod "8c1cad6e-e481-492a-9644-9e6bb203a744" (UID: "8c1cad6e-e481-492a-9644-9e6bb203a744"). InnerVolumeSpecName "kube-api-access-54qd9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:55:59.334419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.334393 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-kube-api-access-nqpvx" pod "8b42b969-1a97-46a9-a2c7-cf24fddebfe5" (UID: "8b42b969-1a97-46a9-a2c7-cf24fddebfe5"). InnerVolumeSpecName "kube-api-access-nqpvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:55:59.335698 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.335673 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-util" pod "8b42b969-1a97-46a9-a2c7-cf24fddebfe5" (UID: "8b42b969-1a97-46a9-a2c7-cf24fddebfe5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:59.336428 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.336407 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-util" pod "8c1cad6e-e481-492a-9644-9e6bb203a744" (UID: "8c1cad6e-e481-492a-9644-9e6bb203a744"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:59.336938 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.336910 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-util" pod "d0461249-5b9f-4ded-882c-384692be91de" (UID: "d0461249-5b9f-4ded-882c-384692be91de"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:55:59.432419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432340 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432363 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432376 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432391 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxlx5\" (UniqueName: \"kubernetes.io/projected/d0461249-5b9f-4ded-882c-384692be91de-kube-api-access-hxlx5\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432406 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d0461249-5b9f-4ded-882c-384692be91de-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432419 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432421 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54qd9\" (UniqueName: \"kubernetes.io/projected/8c1cad6e-e481-492a-9644-9e6bb203a744-kube-api-access-54qd9\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432724 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432435 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432724 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432449 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c1cad6e-e481-492a-9644-9e6bb203a744-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:55:59.432724 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:55:59.432462 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqpvx\" (UniqueName: \"kubernetes.io/projected/8b42b969-1a97-46a9-a2c7-cf24fddebfe5-kube-api-access-nqpvx\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.068370 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.068337 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:00.098725 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.098697 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" event={"ID":"8c1cad6e-e481-492a-9644-9e6bb203a744","Type":"ContainerDied","Data":"cc4fa83233319fba426e20011bc4d5ebfb543e77daa89b18fc5b407185293919"} Nov 03 19:56:00.099109 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.098748 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc4fa83233319fba426e20011bc4d5ebfb543e77daa89b18fc5b407185293919" Nov 03 19:56:00.099109 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.098749 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bh7jd" Nov 03 19:56:00.100714 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.100687 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" Nov 03 19:56:00.100714 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.100698 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be7155s5d" event={"ID":"8b42b969-1a97-46a9-a2c7-cf24fddebfe5","Type":"ContainerDied","Data":"0f3336aac3d186370033ab41539f98353537d11655489063ec5a1cc1ae02c7ee"} Nov 03 19:56:00.100887 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.100735 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f3336aac3d186370033ab41539f98353537d11655489063ec5a1cc1ae02c7ee" Nov 03 19:56:00.102697 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.102679 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" Nov 03 19:56:00.102791 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.102716 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cz2jzl" event={"ID":"d0461249-5b9f-4ded-882c-384692be91de","Type":"ContainerDied","Data":"ee159d58fc0b7078d87441ef37fa28b745c7373be5649b2b9a465c7682f67551"} Nov 03 19:56:00.102791 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.102758 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee159d58fc0b7078d87441ef37fa28b745c7373be5649b2b9a465c7682f67551" Nov 03 19:56:00.247469 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.247261 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:00.255252 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.255229 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:56:00.295320 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.295294 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:56:00.308988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.308967 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:56:00.323303 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.323284 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:56:00.326957 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.326907 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:56:00.339642 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339625 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-util\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-util\") pod \"a6758311-0206-4b99-9cf6-1ca530fce6b7\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " Nov 03 19:56:00.339740 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339659 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-util\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-util\") pod \"1f157c2b-0872-44d7-8221-8ef7ff76692b\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " Nov 03 19:56:00.339740 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339691 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-bundle\") pod \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " Nov 03 19:56:00.339848 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339745 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1f157c2b-0872-44d7-8221-8ef7ff76692b-kube-api-access-9l957\" (UniqueName: \"kubernetes.io/projected/1f157c2b-0872-44d7-8221-8ef7ff76692b-kube-api-access-9l957\") pod \"1f157c2b-0872-44d7-8221-8ef7ff76692b\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " Nov 03 19:56:00.339848 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339779 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-util\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-util\") pod \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " Nov 03 19:56:00.339848 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339836 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-kube-api-access-2xr7s\" (UniqueName: \"kubernetes.io/projected/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-kube-api-access-2xr7s\") pod \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\" (UID: \"7041ce3a-001f-4f7e-8724-f5ee2424c3b7\") " Nov 03 19:56:00.340015 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339880 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-bundle\") pod \"1f157c2b-0872-44d7-8221-8ef7ff76692b\" (UID: \"1f157c2b-0872-44d7-8221-8ef7ff76692b\") " Nov 03 19:56:00.340015 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339969 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a6758311-0206-4b99-9cf6-1ca530fce6b7-kube-api-access-jc9jr\" (UniqueName: \"kubernetes.io/projected/a6758311-0206-4b99-9cf6-1ca530fce6b7-kube-api-access-jc9jr\") pod \"a6758311-0206-4b99-9cf6-1ca530fce6b7\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " Nov 03 19:56:00.340015 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.339997 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-bundle\") pod \"a6758311-0206-4b99-9cf6-1ca530fce6b7\" (UID: \"a6758311-0206-4b99-9cf6-1ca530fce6b7\") " Nov 03 19:56:00.340150 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.340109 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-bundle" pod "7041ce3a-001f-4f7e-8724-f5ee2424c3b7" (UID: "7041ce3a-001f-4f7e-8724-f5ee2424c3b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.340249 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.340234 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.342333 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.342314 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-kube-api-access-2xr7s" pod "7041ce3a-001f-4f7e-8724-f5ee2424c3b7" (UID: "7041ce3a-001f-4f7e-8724-f5ee2424c3b7"). InnerVolumeSpecName "kube-api-access-2xr7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:56:00.342333 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.342322 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-bundle" pod "a6758311-0206-4b99-9cf6-1ca530fce6b7" (UID: "a6758311-0206-4b99-9cf6-1ca530fce6b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.342440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.342395 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-bundle" pod "1f157c2b-0872-44d7-8221-8ef7ff76692b" (UID: "1f157c2b-0872-44d7-8221-8ef7ff76692b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.342622 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.342601 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f157c2b-0872-44d7-8221-8ef7ff76692b-kube-api-access-9l957" pod "1f157c2b-0872-44d7-8221-8ef7ff76692b" (UID: "1f157c2b-0872-44d7-8221-8ef7ff76692b"). InnerVolumeSpecName "kube-api-access-9l957". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:56:00.342760 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.342744 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6758311-0206-4b99-9cf6-1ca530fce6b7-kube-api-access-jc9jr" pod "a6758311-0206-4b99-9cf6-1ca530fce6b7" (UID: "a6758311-0206-4b99-9cf6-1ca530fce6b7"). InnerVolumeSpecName "kube-api-access-jc9jr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:56:00.347075 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.347058 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-util" pod "1f157c2b-0872-44d7-8221-8ef7ff76692b" (UID: "1f157c2b-0872-44d7-8221-8ef7ff76692b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.349402 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.349379 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-util" pod "a6758311-0206-4b99-9cf6-1ca530fce6b7" (UID: "a6758311-0206-4b99-9cf6-1ca530fce6b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.349615 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.349600 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-util" pod "7041ce3a-001f-4f7e-8724-f5ee2424c3b7" (UID: "7041ce3a-001f-4f7e-8724-f5ee2424c3b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.440849 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.440817 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-bundle\") pod \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " Nov 03 19:56:00.441062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.440861 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-kube-api-access-q7rl4\" (UniqueName: \"kubernetes.io/projected/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-kube-api-access-q7rl4\") pod \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " Nov 03 19:56:00.441062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.440890 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-util\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-util\") pod \"3f77eada-b1eb-41fd-a667-e4a638454b26\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " Nov 03 19:56:00.441062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.440920 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-bundle\") pod \"3f77eada-b1eb-41fd-a667-e4a638454b26\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " Nov 03 19:56:00.441062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.440996 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-util\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-util\") pod \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\" (UID: \"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12\") " Nov 03 19:56:00.441062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441030 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3f77eada-b1eb-41fd-a667-e4a638454b26-kube-api-access-lndxk\" (UniqueName: \"kubernetes.io/projected/3f77eada-b1eb-41fd-a667-e4a638454b26-kube-api-access-lndxk\") pod \"3f77eada-b1eb-41fd-a667-e4a638454b26\" (UID: \"3f77eada-b1eb-41fd-a667-e4a638454b26\") " Nov 03 19:56:00.441329 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441245 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441329 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441264 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441329 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441278 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l957\" (UniqueName: \"kubernetes.io/projected/1f157c2b-0872-44d7-8221-8ef7ff76692b-kube-api-access-9l957\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441329 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441291 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441329 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441306 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xr7s\" (UniqueName: \"kubernetes.io/projected/7041ce3a-001f-4f7e-8724-f5ee2424c3b7-kube-api-access-2xr7s\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441329 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441319 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1f157c2b-0872-44d7-8221-8ef7ff76692b-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441593 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441332 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jc9jr\" (UniqueName: \"kubernetes.io/projected/a6758311-0206-4b99-9cf6-1ca530fce6b7-kube-api-access-jc9jr\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441593 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441345 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a6758311-0206-4b99-9cf6-1ca530fce6b7-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.441593 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441373 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-bundle" pod "3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" (UID: "3c7a2a13-bfca-4d7c-a22e-8ef52d431e12"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.441593 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.441524 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-bundle" pod "3f77eada-b1eb-41fd-a667-e4a638454b26" (UID: "3f77eada-b1eb-41fd-a667-e4a638454b26"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.443792 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.443771 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f77eada-b1eb-41fd-a667-e4a638454b26-kube-api-access-lndxk" pod "3f77eada-b1eb-41fd-a667-e4a638454b26" (UID: "3f77eada-b1eb-41fd-a667-e4a638454b26"). InnerVolumeSpecName "kube-api-access-lndxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:56:00.443900 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.443802 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-kube-api-access-q7rl4" pod "3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" (UID: "3c7a2a13-bfca-4d7c-a22e-8ef52d431e12"). InnerVolumeSpecName "kube-api-access-q7rl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:56:00.447020 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.446998 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-util" pod "3f77eada-b1eb-41fd-a667-e4a638454b26" (UID: "3f77eada-b1eb-41fd-a667-e4a638454b26"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.447453 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.447433 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-util" pod "3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" (UID: "3c7a2a13-bfca-4d7c-a22e-8ef52d431e12"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:56:00.542434 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.542401 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.542434 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.542429 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lndxk\" (UniqueName: \"kubernetes.io/projected/3f77eada-b1eb-41fd-a667-e4a638454b26-kube-api-access-lndxk\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.542434 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.542438 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.542642 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.542448 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7rl4\" (UniqueName: \"kubernetes.io/projected/3c7a2a13-bfca-4d7c-a22e-8ef52d431e12-kube-api-access-q7rl4\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.542642 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.542458 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:00.542642 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:00.542467 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f77eada-b1eb-41fd-a667-e4a638454b26-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:56:01.108897 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.108859 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" event={"ID":"3f77eada-b1eb-41fd-a667-e4a638454b26","Type":"ContainerDied","Data":"8f5e37137cfdd1d986b3e59d24015305509f2beb2f0da319500d9433103b5510"} Nov 03 19:56:01.108897 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.108897 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4clv6bf" Nov 03 19:56:01.109384 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.108959 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f5e37137cfdd1d986b3e59d24015305509f2beb2f0da319500d9433103b5510" Nov 03 19:56:01.110972 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.110911 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" event={"ID":"a6758311-0206-4b99-9cf6-1ca530fce6b7","Type":"ContainerDied","Data":"87bc09fab22d7a642522bfdd18a0da069e18b050bf41af605bc3146ce78d5095"} Nov 03 19:56:01.111097 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.110982 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="87bc09fab22d7a642522bfdd18a0da069e18b050bf41af605bc3146ce78d5095" Nov 03 19:56:01.111097 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.110947 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644b47tl" Nov 03 19:56:01.112940 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.112904 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" Nov 03 19:56:01.113048 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.112905 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cd5bmn" event={"ID":"1f157c2b-0872-44d7-8221-8ef7ff76692b","Type":"ContainerDied","Data":"efc6276e96533b6e73e9b2440fdbf6993f46db5d8dda7da43cf202911a5f46d0"} Nov 03 19:56:01.113048 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.112998 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efc6276e96533b6e73e9b2440fdbf6993f46db5d8dda7da43cf202911a5f46d0" Nov 03 19:56:01.114972 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.114947 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" event={"ID":"3c7a2a13-bfca-4d7c-a22e-8ef52d431e12","Type":"ContainerDied","Data":"95e5888801c606b79fbcf60e2d22ec1a79c5abb1bd7fb9761d37955c43888c9b"} Nov 03 19:56:01.114972 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.114965 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65x4lj" Nov 03 19:56:01.115152 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.114986 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95e5888801c606b79fbcf60e2d22ec1a79c5abb1bd7fb9761d37955c43888c9b" Nov 03 19:56:01.116963 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.116917 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" event={"ID":"7041ce3a-001f-4f7e-8724-f5ee2424c3b7","Type":"ContainerDied","Data":"051caea1b7b274767d8f0e5499a098dbdf3133d1c7bb7b52c665b167bf17fdbc"} Nov 03 19:56:01.117072 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.116979 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="051caea1b7b274767d8f0e5499a098dbdf3133d1c7bb7b52c665b167bf17fdbc" Nov 03 19:56:01.117072 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:01.116989 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qldmk" Nov 03 19:56:02.908441 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:02.908345 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:03.099135 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:03.099096 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:04.026494 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:04.026466 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:05.046187 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:05.046155 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:07.570226 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:56:07.570190 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:56:08.069174 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069143 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r"] Nov 03 19:56:08.069537 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069520 5024 cpu_manager.go:414] "containerMap: removing container" podUID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerName="pull" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069539 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerName="pull" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069554 5024 cpu_manager.go:414] "containerMap: removing container" podUID="c2ebc500-0cab-4261-84aa-86d33875e959" containerName="extract" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069562 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2ebc500-0cab-4261-84aa-86d33875e959" containerName="extract" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069574 5024 cpu_manager.go:414] "containerMap: removing container" podUID="29e80428-c490-463e-b86f-7194b02c57aa" containerName="extract" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069581 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29e80428-c490-463e-b86f-7194b02c57aa" containerName="extract" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069590 5024 cpu_manager.go:414] "containerMap: removing container" podUID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerName="extract" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069596 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerName="extract" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069607 5024 cpu_manager.go:414] "containerMap: removing container" podUID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerName="extract" Nov 03 19:56:08.069625 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069613 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069629 5024 cpu_manager.go:414] "containerMap: removing container" podUID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069636 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069645 5024 cpu_manager.go:414] "containerMap: removing container" podUID="c2ebc500-0cab-4261-84aa-86d33875e959" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069652 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2ebc500-0cab-4261-84aa-86d33875e959" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069661 5024 cpu_manager.go:414] "containerMap: removing container" podUID="29e80428-c490-463e-b86f-7194b02c57aa" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069668 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29e80428-c490-463e-b86f-7194b02c57aa" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069679 5024 cpu_manager.go:414] "containerMap: removing container" podUID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069686 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069695 5024 cpu_manager.go:414] "containerMap: removing container" podUID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069702 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069711 5024 cpu_manager.go:414] "containerMap: removing container" podUID="d0461249-5b9f-4ded-882c-384692be91de" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069718 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0461249-5b9f-4ded-882c-384692be91de" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069728 5024 cpu_manager.go:414] "containerMap: removing container" podUID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069735 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069743 5024 cpu_manager.go:414] "containerMap: removing container" podUID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069748 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069759 5024 cpu_manager.go:414] "containerMap: removing container" podUID="29e80428-c490-463e-b86f-7194b02c57aa" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069766 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="29e80428-c490-463e-b86f-7194b02c57aa" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069775 5024 cpu_manager.go:414] "containerMap: removing container" podUID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069781 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069793 5024 cpu_manager.go:414] "containerMap: removing container" podUID="d0461249-5b9f-4ded-882c-384692be91de" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069800 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0461249-5b9f-4ded-882c-384692be91de" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069812 5024 cpu_manager.go:414] "containerMap: removing container" podUID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069819 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069829 5024 cpu_manager.go:414] "containerMap: removing container" podUID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069835 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069846 5024 cpu_manager.go:414] "containerMap: removing container" podUID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069853 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069866 5024 cpu_manager.go:414] "containerMap: removing container" podUID="d0461249-5b9f-4ded-882c-384692be91de" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069873 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0461249-5b9f-4ded-882c-384692be91de" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069882 5024 cpu_manager.go:414] "containerMap: removing container" podUID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069889 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069901 5024 cpu_manager.go:414] "containerMap: removing container" podUID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069908 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069918 5024 cpu_manager.go:414] "containerMap: removing container" podUID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069941 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069953 5024 cpu_manager.go:414] "containerMap: removing container" podUID="c2ebc500-0cab-4261-84aa-86d33875e959" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069959 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2ebc500-0cab-4261-84aa-86d33875e959" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069970 5024 cpu_manager.go:414] "containerMap: removing container" podUID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069976 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069992 5024 cpu_manager.go:414] "containerMap: removing container" podUID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.069998 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070008 5024 cpu_manager.go:414] "containerMap: removing container" podUID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070014 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerName="pull" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070026 5024 cpu_manager.go:414] "containerMap: removing container" podUID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070032 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070042 5024 cpu_manager.go:414] "containerMap: removing container" podUID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070048 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerName="util" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070060 5024 cpu_manager.go:414] "containerMap: removing container" podUID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerName="extract" Nov 03 19:56:08.070100 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070067 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070162 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="7041ce3a-001f-4f7e-8724-f5ee2424c3b7" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070173 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="1f157c2b-0872-44d7-8221-8ef7ff76692b" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070185 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="a6758311-0206-4b99-9cf6-1ca530fce6b7" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070195 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2ebc500-0cab-4261-84aa-86d33875e959" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070203 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="29e80428-c490-463e-b86f-7194b02c57aa" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070211 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="8c1cad6e-e481-492a-9644-9e6bb203a744" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070218 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="3f77eada-b1eb-41fd-a667-e4a638454b26" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070228 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0461249-5b9f-4ded-882c-384692be91de" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070235 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="3c7a2a13-bfca-4d7c-a22e-8ef52d431e12" containerName="extract" Nov 03 19:56:08.072008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.070244 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b42b969-1a97-46a9-a2c7-cf24fddebfe5" containerName="extract" Nov 03 19:56:08.072417 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.072400 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" Nov 03 19:56:08.125139 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.125118 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 03 19:56:08.174359 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.174337 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 03 19:56:08.174359 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.174355 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-svrx8\"" Nov 03 19:56:08.176138 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.176120 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r"] Nov 03 19:56:08.199256 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.199233 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8wm5\" (UniqueName: \"kubernetes.io/projected/d1d835fd-33ea-47c0-a306-929c8ac31e13-kube-api-access-d8wm5\") pod \"authorino-operator-7b7bb4bc77-pdd6r\" (UID: \"d1d835fd-33ea-47c0-a306-929c8ac31e13\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" Nov 03 19:56:08.300074 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.300043 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8wm5\" (UniqueName: \"kubernetes.io/projected/d1d835fd-33ea-47c0-a306-929c8ac31e13-kube-api-access-d8wm5\") pod \"authorino-operator-7b7bb4bc77-pdd6r\" (UID: \"d1d835fd-33ea-47c0-a306-929c8ac31e13\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" Nov 03 19:56:08.363783 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.363710 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8wm5\" (UniqueName: \"kubernetes.io/projected/d1d835fd-33ea-47c0-a306-929c8ac31e13-kube-api-access-d8wm5\") pod \"authorino-operator-7b7bb4bc77-pdd6r\" (UID: \"d1d835fd-33ea-47c0-a306-929c8ac31e13\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" Nov 03 19:56:08.383352 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.383324 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" Nov 03 19:56:08.752543 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.752519 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r"] Nov 03 19:56:08.754458 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:56:08.754433 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d835fd_33ea_47c0_a306_929c8ac31e13.slice/crio-1be5a19cf254bccf72d352dbd770eccb2d62901686a006a352aeadc329e76ae3 WatchSource:0}: Error finding container 1be5a19cf254bccf72d352dbd770eccb2d62901686a006a352aeadc329e76ae3: Status 404 returned error can't find the container with id 1be5a19cf254bccf72d352dbd770eccb2d62901686a006a352aeadc329e76ae3 Nov 03 19:56:08.756617 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:08.756598 5024 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 19:56:09.155403 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:09.155365 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" event={"ID":"d1d835fd-33ea-47c0-a306-929c8ac31e13","Type":"ContainerStarted","Data":"1be5a19cf254bccf72d352dbd770eccb2d62901686a006a352aeadc329e76ae3"} Nov 03 19:56:09.636645 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:09.636560 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:10.054529 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:10.054491 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:10.238548 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:10.238515 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:11.280740 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.280680 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:11.568603 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.568528 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277"] Nov 03 19:56:11.573056 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.573027 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.629204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.629167 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-metrics-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.629204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.629207 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.629421 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.629236 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-tmp\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.629421 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.629360 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-manifests\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.629421 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.629392 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgfm\" (UniqueName: \"kubernetes.io/projected/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-kube-api-access-8jgfm\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.629548 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.629429 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-webhook-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.685097 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.685059 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 03 19:56:11.685307 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.685282 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 03 19:56:11.685460 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.685438 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-tffct\"" Nov 03 19:56:11.685522 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.685464 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 03 19:56:11.706201 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.706173 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277"] Nov 03 19:56:11.708460 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.708439 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 03 19:56:11.708588 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.708547 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 03 19:56:11.730277 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.730234 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-metrics-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.730433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.730283 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.730433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.730312 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-tmp\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.730433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.730367 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-manifests\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.730433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.730392 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgfm\" (UniqueName: \"kubernetes.io/projected/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-kube-api-access-8jgfm\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.730433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.730429 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-webhook-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.731051 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.731030 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-manifests\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.731498 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.731401 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:11.733227 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.733205 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-metrics-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.733341 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.733281 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.733341 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.733313 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-webhook-cert\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.733545 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.733525 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-tmp\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.799635 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.799595 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgfm\" (UniqueName: \"kubernetes.io/projected/5cfad0e0-c9ad-4752-87c2-4bdb47c0140d-kube-api-access-8jgfm\") pod \"opendatahub-operator-controller-manager-756fd67b76-ln277\" (UID: \"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.889202 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.889173 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:11.909543 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:11.909512 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:12.088116 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:12.088085 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:12.335395 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:12.335309 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:12.390388 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:12.390364 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277"] Nov 03 19:56:12.392470 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:56:12.392445 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cfad0e0_c9ad_4752_87c2_4bdb47c0140d.slice/crio-df6603bec3e581b3af481757ce89b2badd4d747fec451708e9bed24ba8639f7e WatchSource:0}: Error finding container df6603bec3e581b3af481757ce89b2badd4d747fec451708e9bed24ba8639f7e: Status 404 returned error can't find the container with id df6603bec3e581b3af481757ce89b2badd4d747fec451708e9bed24ba8639f7e Nov 03 19:56:13.176414 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:13.176379 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" event={"ID":"d1d835fd-33ea-47c0-a306-929c8ac31e13","Type":"ContainerStarted","Data":"b5feaf33c7faade680b956dc8beebbc71a7b14abe0380ea623c4a266648e7a59"} Nov 03 19:56:13.176623 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:13.176483 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" Nov 03 19:56:13.177818 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:13.177792 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" event={"ID":"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d","Type":"ContainerStarted","Data":"df6603bec3e581b3af481757ce89b2badd4d747fec451708e9bed24ba8639f7e"} Nov 03 19:56:13.297484 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:13.297432 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" podStartSLOduration=1.590289046 podStartE2EDuration="5.297416571s" totalImagesPullingTime="3.707127525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:13.295731906 +0000 UTC m=+321.077448585" watchObservedRunningTime="2026-11-03 19:56:13.297416571 +0000 UTC m=+321.079133235" Nov 03 19:56:13.889201 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:13.889161 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:14.063787 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:14.063722 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:15.982875 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:15.982841 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:16.164258 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.164221 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:16.691536 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.691507 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf"] Nov 03 19:56:16.693583 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.693563 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" Nov 03 19:56:16.773847 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.773818 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf6fc\" (UniqueName: \"kubernetes.io/projected/80170616-a5ce-47e9-bda2-2cd8695aa3f1-kube-api-access-wf6fc\") pod \"limitador-operator-controller-manager-5778bb4449-2sxcf\" (UID: \"80170616-a5ce-47e9-bda2-2cd8695aa3f1\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" Nov 03 19:56:16.797792 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.797771 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f6h7s\"" Nov 03 19:56:16.799640 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.799619 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf"] Nov 03 19:56:16.875213 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.875189 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf6fc\" (UniqueName: \"kubernetes.io/projected/80170616-a5ce-47e9-bda2-2cd8695aa3f1-kube-api-access-wf6fc\") pod \"limitador-operator-controller-manager-5778bb4449-2sxcf\" (UID: \"80170616-a5ce-47e9-bda2-2cd8695aa3f1\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" Nov 03 19:56:16.938339 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:16.938307 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf6fc\" (UniqueName: \"kubernetes.io/projected/80170616-a5ce-47e9-bda2-2cd8695aa3f1-kube-api-access-wf6fc\") pod \"limitador-operator-controller-manager-5778bb4449-2sxcf\" (UID: \"80170616-a5ce-47e9-bda2-2cd8695aa3f1\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" Nov 03 19:56:17.005942 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.005860 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" Nov 03 19:56:17.201758 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.201724 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" event={"ID":"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d","Type":"ContainerStarted","Data":"6bf5c5c2fed9a143f8c698c0720f62406b38a4722a1f547531ba35b3a1e2a07f"} Nov 03 19:56:17.374720 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.374701 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf"] Nov 03 19:56:17.413662 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:56:17.413637 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80170616_a5ce_47e9_bda2_2cd8695aa3f1.slice/crio-56f329f91cb73130d3730a9e4a9884f263da0efc2bd9443a02408380aad028fc WatchSource:0}: Error finding container 56f329f91cb73130d3730a9e4a9884f263da0efc2bd9443a02408380aad028fc: Status 404 returned error can't find the container with id 56f329f91cb73130d3730a9e4a9884f263da0efc2bd9443a02408380aad028fc Nov 03 19:56:17.633472 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.633406 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:17.906345 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.906316 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98"] Nov 03 19:56:17.922188 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.922167 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:17.974990 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.974958 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Nov 03 19:56:17.975165 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.975030 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Nov 03 19:56:17.975165 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.975089 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w5xhv\"" Nov 03 19:56:17.977153 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.977129 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98"] Nov 03 19:56:17.984494 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.984468 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d75a6e43-aca0-40f2-9285-d8e014a1f20a-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-lcc98\" (UID: \"d75a6e43-aca0-40f2-9285-d8e014a1f20a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:17.984639 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:17.984508 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld7vw\" (UniqueName: \"kubernetes.io/projected/d75a6e43-aca0-40f2-9285-d8e014a1f20a-kube-api-access-ld7vw\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-lcc98\" (UID: \"d75a6e43-aca0-40f2-9285-d8e014a1f20a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:18.085740 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.085707 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d75a6e43-aca0-40f2-9285-d8e014a1f20a-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-lcc98\" (UID: \"d75a6e43-aca0-40f2-9285-d8e014a1f20a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:18.085740 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.085741 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld7vw\" (UniqueName: \"kubernetes.io/projected/d75a6e43-aca0-40f2-9285-d8e014a1f20a-kube-api-access-ld7vw\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-lcc98\" (UID: \"d75a6e43-aca0-40f2-9285-d8e014a1f20a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:18.086157 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.086087 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d75a6e43-aca0-40f2-9285-d8e014a1f20a-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-lcc98\" (UID: \"d75a6e43-aca0-40f2-9285-d8e014a1f20a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:18.146750 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.146721 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld7vw\" (UniqueName: \"kubernetes.io/projected/d75a6e43-aca0-40f2-9285-d8e014a1f20a-kube-api-access-ld7vw\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-lcc98\" (UID: \"d75a6e43-aca0-40f2-9285-d8e014a1f20a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:18.209568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.209491 5024 generic.go:356] "Generic (PLEG): container finished" podID="5cfad0e0-c9ad-4752-87c2-4bdb47c0140d" containerID="6bf5c5c2fed9a143f8c698c0720f62406b38a4722a1f547531ba35b3a1e2a07f" exitCode=0 Nov 03 19:56:18.209718 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.209572 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" event={"ID":"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d","Type":"ContainerDied","Data":"6bf5c5c2fed9a143f8c698c0720f62406b38a4722a1f547531ba35b3a1e2a07f"} Nov 03 19:56:18.211190 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.210964 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" event={"ID":"80170616-a5ce-47e9-bda2-2cd8695aa3f1","Type":"ContainerStarted","Data":"56f329f91cb73130d3730a9e4a9884f263da0efc2bd9443a02408380aad028fc"} Nov 03 19:56:18.233193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.233167 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" Nov 03 19:56:18.445066 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.445027 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:18.702488 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.702467 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98"] Nov 03 19:56:18.705120 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:56:18.705093 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd75a6e43_aca0_40f2_9285_d8e014a1f20a.slice/crio-221e7e426f78bb95fef5dd6ab835de5b35b49e5afb2776292ae7ed89e2828a21 WatchSource:0}: Error finding container 221e7e426f78bb95fef5dd6ab835de5b35b49e5afb2776292ae7ed89e2828a21: Status 404 returned error can't find the container with id 221e7e426f78bb95fef5dd6ab835de5b35b49e5afb2776292ae7ed89e2828a21 Nov 03 19:56:18.815525 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:18.815490 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:19.043757 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:19.043681 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:19.218610 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:19.218577 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" event={"ID":"5cfad0e0-c9ad-4752-87c2-4bdb47c0140d","Type":"ContainerStarted","Data":"5fad5a672c7a7f678670bb052404b590d7dec1630fe8987c0cf2a0f5a3e098ca"} Nov 03 19:56:19.219030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:19.218723 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:19.219863 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:19.219843 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" event={"ID":"d75a6e43-aca0-40f2-9285-d8e014a1f20a","Type":"ContainerStarted","Data":"221e7e426f78bb95fef5dd6ab835de5b35b49e5afb2776292ae7ed89e2828a21"} Nov 03 19:56:19.334544 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:19.334468 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:19.371131 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:19.371045 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" podStartSLOduration=2.624338312 podStartE2EDuration="8.371028152s" totalImagesPullingTime="5.182023475s" totalInitContainerRuntime="564.666365ms" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:19.367921625 +0000 UTC m=+327.149638290" watchObservedRunningTime="2026-11-03 19:56:19.371028152 +0000 UTC m=+327.152744809" Nov 03 19:56:20.226204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:20.226115 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" event={"ID":"80170616-a5ce-47e9-bda2-2cd8695aa3f1","Type":"ContainerStarted","Data":"08b58fdf93bfdd52ad30c82c4261e0321e32ef8d317686c87f97d99a76f24632"} Nov 03 19:56:20.226542 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:20.226407 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" Nov 03 19:56:20.346538 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:20.346491 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" podStartSLOduration=1.8250364700000001 podStartE2EDuration="4.346477532s" totalImagesPullingTime="2.521441062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:20.345057407 +0000 UTC m=+328.126774084" watchObservedRunningTime="2026-11-03 19:56:20.346477532 +0000 UTC m=+328.128194197" Nov 03 19:56:20.765371 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:20.765339 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:21.152502 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:21.152470 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:21.703149 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:21.703081 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:21.919186 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:21.919151 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:22.238239 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:22.238203 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" event={"ID":"d75a6e43-aca0-40f2-9285-d8e014a1f20a","Type":"ContainerStarted","Data":"1ebff2f46811f2e47b28df8f48633374aff923bf6747fa7cc5e00ba1482f89c1"} Nov 03 19:56:22.376037 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:22.376001 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:22.463037 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:22.462992 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-lcc98" podStartSLOduration=2.786975098 podStartE2EDuration="5.462977619s" totalImagesPullingTime="2.676002521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:22.412303475 +0000 UTC m=+330.194020141" watchObservedRunningTime="2026-11-03 19:56:22.462977619 +0000 UTC m=+330.244694284" Nov 03 19:56:22.633118 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:22.633043 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:24.185786 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:24.185758 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-pdd6r" Nov 03 19:56:24.240177 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:24.240130 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:24.540007 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:24.539905 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:24.805773 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:24.805690 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:25.630665 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.630621 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq"] Nov 03 19:56:25.637105 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.637081 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:25.688115 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.688085 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq"] Nov 03 19:56:25.734633 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.734604 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-szfv7\"" Nov 03 19:56:25.752081 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.752050 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb726d2e-89ab-4754-af02-537fdea524f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-85txq\" (UID: \"fb726d2e-89ab-4754-af02-537fdea524f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:25.752081 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.752082 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d668\" (UniqueName: \"kubernetes.io/projected/fb726d2e-89ab-4754-af02-537fdea524f3-kube-api-access-8d668\") pod \"kuadrant-operator-controller-manager-678d87766f-85txq\" (UID: \"fb726d2e-89ab-4754-af02-537fdea524f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:25.852977 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.852913 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb726d2e-89ab-4754-af02-537fdea524f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-85txq\" (UID: \"fb726d2e-89ab-4754-af02-537fdea524f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:25.852977 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.852978 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d668\" (UniqueName: \"kubernetes.io/projected/fb726d2e-89ab-4754-af02-537fdea524f3-kube-api-access-8d668\") pod \"kuadrant-operator-controller-manager-678d87766f-85txq\" (UID: \"fb726d2e-89ab-4754-af02-537fdea524f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:25.853314 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.853296 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb726d2e-89ab-4754-af02-537fdea524f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-85txq\" (UID: \"fb726d2e-89ab-4754-af02-537fdea524f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:25.914934 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.914900 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d668\" (UniqueName: \"kubernetes.io/projected/fb726d2e-89ab-4754-af02-537fdea524f3-kube-api-access-8d668\") pod \"kuadrant-operator-controller-manager-678d87766f-85txq\" (UID: \"fb726d2e-89ab-4754-af02-537fdea524f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:25.949626 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:25.949591 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:26.386406 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:26.386316 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:26.433606 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:26.433582 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq"] Nov 03 19:56:26.434869 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:56:26.434836 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb726d2e_89ab_4754_af02_537fdea524f3.slice/crio-3c779b9053082cf0433c3ea2de185ed0c686ba8941affc46cda73a0ed86152f1 WatchSource:0}: Error finding container 3c779b9053082cf0433c3ea2de185ed0c686ba8941affc46cda73a0ed86152f1: Status 404 returned error can't find the container with id 3c779b9053082cf0433c3ea2de185ed0c686ba8941affc46cda73a0ed86152f1 Nov 03 19:56:27.038155 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:27.038121 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:27.235204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:27.235171 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:27.265180 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:27.265144 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" event={"ID":"fb726d2e-89ab-4754-af02-537fdea524f3","Type":"ContainerStarted","Data":"3c779b9053082cf0433c3ea2de185ed0c686ba8941affc46cda73a0ed86152f1"} Nov 03 19:56:29.462873 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:29.462818 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:29.641388 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:29.641353 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:30.055008 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:30.054974 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:30.228544 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:30.228519 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-756fd67b76-ln277" Nov 03 19:56:30.272550 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:30.272506 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:32.240970 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:32.240937 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-2sxcf" Nov 03 19:56:32.298386 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:32.298347 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" event={"ID":"fb726d2e-89ab-4754-af02-537fdea524f3","Type":"ContainerStarted","Data":"717c03a3828e9b9907a537fcb1253c04c18533779fa5e53365b7868e48c42a4c"} Nov 03 19:56:32.298546 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:32.298492 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:32.514968 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:32.514906 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" podStartSLOduration=1.866438899 podStartE2EDuration="7.514889478s" totalImagesPullingTime="5.648450579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:32.512686415 +0000 UTC m=+340.294403091" watchObservedRunningTime="2026-11-03 19:56:32.514889478 +0000 UTC m=+340.296606145" Nov 03 19:56:33.915856 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:33.915827 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:34.114056 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:34.113991 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:34.777046 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:34.777017 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:35.647587 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:35.647555 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:35.982385 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:35.982304 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:36.453228 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:36.453193 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:36.631406 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:36.631377 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:37.570708 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:56:37.570672 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:56:39.672334 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:39.672304 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:39.864214 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:39.864173 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:42.254735 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:42.254694 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:42.437398 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:42.437353 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:43.305846 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:43.305819 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-85txq" Nov 03 19:56:43.367405 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:43.367355 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:44.608061 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:44.608028 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:44.787031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:44.786999 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:45.259310 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:45.259265 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:45.436573 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:45.436543 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:45.875533 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:45.875494 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:46.058728 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:46.058697 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:46.926941 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:46.926901 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:47.143193 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.143166 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:47.323712 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.323636 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:47.452640 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.452601 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx"] Nov 03 19:56:47.487602 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.487566 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.518325 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.518298 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx"] Nov 03 19:56:47.545087 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545054 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545087 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545087 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e0025fc-d687-4181-9123-976fe02bcdbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545295 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545112 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545295 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545193 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25fj\" (UniqueName: \"kubernetes.io/projected/4e0025fc-d687-4181-9123-976fe02bcdbe-kube-api-access-w25fj\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545295 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545226 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545295 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545264 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545428 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545323 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545428 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545353 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.545428 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.545379 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.565014 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.564988 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vlflf\"" Nov 03 19:56:47.581212 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.581136 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:47.645725 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.645697 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.645725 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.645727 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.645881 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.645744 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.645881 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.645857 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.645981 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.645919 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.645981 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.645963 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e0025fc-d687-4181-9123-976fe02bcdbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646078 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.645988 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646078 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.646029 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25fj\" (UniqueName: \"kubernetes.io/projected/4e0025fc-d687-4181-9123-976fe02bcdbe-kube-api-access-w25fj\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646176 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.646075 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646281 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.646258 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646388 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.646367 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646627 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.646606 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e0025fc-d687-4181-9123-976fe02bcdbe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646862 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.646846 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.646968 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.646844 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.648137 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.648116 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.648532 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.648510 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.712628 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.712600 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e0025fc-d687-4181-9123-976fe02bcdbe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.712758 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.712667 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25fj\" (UniqueName: \"kubernetes.io/projected/4e0025fc-d687-4181-9123-976fe02bcdbe-kube-api-access-w25fj\") pod \"data-science-gateway-data-science-gateway-class-76f56c5945fk5rx\" (UID: \"4e0025fc-d687-4181-9123-976fe02bcdbe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:47.773290 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.773256 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:47.803745 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:47.803723 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:48.261876 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.261849 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx"] Nov 03 19:56:48.263738 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:56:48.263705 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0025fc_d687_4181_9123_976fe02bcdbe.slice/crio-22877f285ea8cfa76067204ea9a644ad1705969d8e0565bfd70ba429b12ada52 WatchSource:0}: Error finding container 22877f285ea8cfa76067204ea9a644ad1705969d8e0565bfd70ba429b12ada52: Status 404 returned error can't find the container with id 22877f285ea8cfa76067204ea9a644ad1705969d8e0565bfd70ba429b12ada52 Nov 03 19:56:48.266093 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.266061 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:56:48.266160 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.266126 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:56:48.266160 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.266153 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:56:48.387058 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.386776 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" event={"ID":"4e0025fc-d687-4181-9123-976fe02bcdbe","Type":"ContainerStarted","Data":"824ff96e76903ea9581d9d70a36e631b4d9efe0e9cdf01a86b072b9c343422da"} Nov 03 19:56:48.387058 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.386873 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" event={"ID":"4e0025fc-d687-4181-9123-976fe02bcdbe","Type":"ContainerStarted","Data":"22877f285ea8cfa76067204ea9a644ad1705969d8e0565bfd70ba429b12ada52"} Nov 03 19:56:48.509700 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.509647 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" podStartSLOduration=1.509631537 podStartE2EDuration="1.509631537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:48.507128423 +0000 UTC m=+356.288845086" watchObservedRunningTime="2026-11-03 19:56:48.509631537 +0000 UTC m=+356.291348197" Nov 03 19:56:48.804307 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:48.804273 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:49.204710 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.204677 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:49.257665 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.257631 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-brl7b"] Nov 03 19:56:49.259978 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.259958 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.313399 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.313373 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z4ztg\"" Nov 03 19:56:49.360888 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.360838 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2185e83e-3a7c-4c31-905d-a2f7728ff138-config-file\") pod \"limitador-limitador-74dfcfb894-brl7b\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.361074 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.360903 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvxgg\" (UniqueName: \"kubernetes.io/projected/2185e83e-3a7c-4c31-905d-a2f7728ff138-kube-api-access-gvxgg\") pod \"limitador-limitador-74dfcfb894-brl7b\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.362474 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.362454 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 03 19:56:49.364473 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.364455 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-brl7b"] Nov 03 19:56:49.461983 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.461862 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2185e83e-3a7c-4c31-905d-a2f7728ff138-config-file\") pod \"limitador-limitador-74dfcfb894-brl7b\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.461983 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.461965 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvxgg\" (UniqueName: \"kubernetes.io/projected/2185e83e-3a7c-4c31-905d-a2f7728ff138-kube-api-access-gvxgg\") pod \"limitador-limitador-74dfcfb894-brl7b\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.462573 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.462551 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2185e83e-3a7c-4c31-905d-a2f7728ff138-config-file\") pod \"limitador-limitador-74dfcfb894-brl7b\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.506213 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.506179 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-brl7b"] Nov 03 19:56:49.540345 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.540311 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvxgg\" (UniqueName: \"kubernetes.io/projected/2185e83e-3a7c-4c31-905d-a2f7728ff138-kube-api-access-gvxgg\") pod \"limitador-limitador-74dfcfb894-brl7b\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.571263 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.571224 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:49.654763 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.654725 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:49.809533 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.809456 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:49.840399 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.840363 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:49.940977 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:49.940743 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-brl7b"] Nov 03 19:56:49.945061 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:56:49.945030 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2185e83e_3a7c_4c31_905d_a2f7728ff138.slice/crio-b5467ba7b88d81d8589bbae5a87bb4ba75e1684080b92e2e7f170ce62f01d4ab WatchSource:0}: Error finding container b5467ba7b88d81d8589bbae5a87bb4ba75e1684080b92e2e7f170ce62f01d4ab: Status 404 returned error can't find the container with id b5467ba7b88d81d8589bbae5a87bb4ba75e1684080b92e2e7f170ce62f01d4ab Nov 03 19:56:50.397875 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:50.397838 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" event={"ID":"2185e83e-3a7c-4c31-905d-a2f7728ff138","Type":"ContainerStarted","Data":"b5467ba7b88d81d8589bbae5a87bb4ba75e1684080b92e2e7f170ce62f01d4ab"} Nov 03 19:56:50.398276 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:50.398168 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:50.398966 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:50.398950 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-76f56c5945fk5rx" Nov 03 19:56:50.984528 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:50.984494 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:51.166265 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:51.166232 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:52.408113 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:52.408070 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" event={"ID":"2185e83e-3a7c-4c31-905d-a2f7728ff138","Type":"ContainerStarted","Data":"edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f"} Nov 03 19:56:52.408557 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:52.408248 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:56:52.524518 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:52.524466 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" podStartSLOduration=1.583705706 podStartE2EDuration="3.524454607s" totalImagesPullingTime="1.940748901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:56:52.524116233 +0000 UTC m=+360.305832910" watchObservedRunningTime="2026-11-03 19:56:52.524454607 +0000 UTC m=+360.306171300" Nov 03 19:56:54.998018 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:54.997989 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:56:59.691732 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.691700 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7"] Nov 03 19:56:59.696701 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.696681 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.750325 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.750293 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561d6e07-50cc-4c3f-b401-facef6d19780-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.750325 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.750326 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/561d6e07-50cc-4c3f-b401-facef6d19780-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.750516 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.750348 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dvf\" (UniqueName: \"kubernetes.io/projected/561d6e07-50cc-4c3f-b401-facef6d19780-kube-api-access-w7dvf\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.750516 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.750369 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/561d6e07-50cc-4c3f-b401-facef6d19780-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.751368 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.751347 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 03 19:56:59.801166 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.801139 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 03 19:56:59.801166 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.801136 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-tkhzr\"" Nov 03 19:56:59.851056 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.851016 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561d6e07-50cc-4c3f-b401-facef6d19780-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.851227 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.851071 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/561d6e07-50cc-4c3f-b401-facef6d19780-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.851227 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.851103 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dvf\" (UniqueName: \"kubernetes.io/projected/561d6e07-50cc-4c3f-b401-facef6d19780-kube-api-access-w7dvf\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.851227 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.851137 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/561d6e07-50cc-4c3f-b401-facef6d19780-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.851511 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.851494 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561d6e07-50cc-4c3f-b401-facef6d19780-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.851553 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.851522 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/561d6e07-50cc-4c3f-b401-facef6d19780-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.901127 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.901098 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\"" Nov 03 19:56:59.901881 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.901862 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/561d6e07-50cc-4c3f-b401-facef6d19780-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:56:59.903245 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.903229 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7"] Nov 03 19:56:59.911875 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:56:59.911855 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dvf\" (UniqueName: \"kubernetes.io/projected/561d6e07-50cc-4c3f-b401-facef6d19780-kube-api-access-w7dvf\") pod \"kserve-module-controller-manager-7566cf5fc8-6hch7\" (UID: \"561d6e07-50cc-4c3f-b401-facef6d19780\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:57:00.008971 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:00.008839 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:57:00.432563 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:00.432540 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7"] Nov 03 19:57:00.434208 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:57:00.434181 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561d6e07_50cc_4c3f_b401_facef6d19780.slice/crio-f34fa4faffd61d2f047085812c36d42fed0fda5f47edd97a6fa3cd0dea4ee6cb WatchSource:0}: Error finding container f34fa4faffd61d2f047085812c36d42fed0fda5f47edd97a6fa3cd0dea4ee6cb: Status 404 returned error can't find the container with id f34fa4faffd61d2f047085812c36d42fed0fda5f47edd97a6fa3cd0dea4ee6cb Nov 03 19:57:00.448635 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:00.448607 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" event={"ID":"561d6e07-50cc-4c3f-b401-facef6d19780","Type":"ContainerStarted","Data":"f34fa4faffd61d2f047085812c36d42fed0fda5f47edd97a6fa3cd0dea4ee6cb"} Nov 03 19:57:01.996842 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:01.996803 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:02.171982 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:02.171942 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:02.352710 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:02.352637 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:03.414627 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:03.414593 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:57:03.468404 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:03.468366 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" event={"ID":"561d6e07-50cc-4c3f-b401-facef6d19780","Type":"ContainerStarted","Data":"dd5b4677365b7b627ed7b9ad51ad5b47f5661f0bf498c20b91f5c0407dc5ab7a"} Nov 03 19:57:03.468568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:03.468456 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:57:03.649393 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:03.649341 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" podStartSLOduration=1.773521839 podStartE2EDuration="4.649325206s" totalImagesPullingTime="2.875803367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:57:03.648400657 +0000 UTC m=+371.430117325" watchObservedRunningTime="2026-11-03 19:57:03.649325206 +0000 UTC m=+371.431041901" Nov 03 19:57:06.074165 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:06.074137 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:06.254492 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:06.254458 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:07.571261 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:57:07.571224 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:57:09.648873 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:09.648839 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-brl7b"] Nov 03 19:57:09.649353 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:09.649074 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" podUID="2185e83e-3a7c-4c31-905d-a2f7728ff138" containerName="limitador" containerID="cri-o://edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f" gracePeriod=30 Nov 03 19:57:10.190214 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.190188 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:57:10.241839 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.241762 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2185e83e-3a7c-4c31-905d-a2f7728ff138-config-file\" (UniqueName: \"kubernetes.io/configmap/2185e83e-3a7c-4c31-905d-a2f7728ff138-config-file\") pod \"2185e83e-3a7c-4c31-905d-a2f7728ff138\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " Nov 03 19:57:10.241839 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.241801 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2185e83e-3a7c-4c31-905d-a2f7728ff138-kube-api-access-gvxgg\" (UniqueName: \"kubernetes.io/projected/2185e83e-3a7c-4c31-905d-a2f7728ff138-kube-api-access-gvxgg\") pod \"2185e83e-3a7c-4c31-905d-a2f7728ff138\" (UID: \"2185e83e-3a7c-4c31-905d-a2f7728ff138\") " Nov 03 19:57:10.242190 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.242166 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2185e83e-3a7c-4c31-905d-a2f7728ff138-config-file" pod "2185e83e-3a7c-4c31-905d-a2f7728ff138" (UID: "2185e83e-3a7c-4c31-905d-a2f7728ff138"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 19:57:10.244178 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.244142 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2185e83e-3a7c-4c31-905d-a2f7728ff138-kube-api-access-gvxgg" pod "2185e83e-3a7c-4c31-905d-a2f7728ff138" (UID: "2185e83e-3a7c-4c31-905d-a2f7728ff138"). InnerVolumeSpecName "kube-api-access-gvxgg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:57:10.342719 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.342697 5024 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2185e83e-3a7c-4c31-905d-a2f7728ff138-config-file\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:57:10.342719 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.342721 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvxgg\" (UniqueName: \"kubernetes.io/projected/2185e83e-3a7c-4c31-905d-a2f7728ff138-kube-api-access-gvxgg\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:57:10.506112 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.506032 5024 generic.go:356] "Generic (PLEG): container finished" podID="2185e83e-3a7c-4c31-905d-a2f7728ff138" containerID="edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f" exitCode=0 Nov 03 19:57:10.506112 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.506080 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" Nov 03 19:57:10.506112 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.506101 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" event={"ID":"2185e83e-3a7c-4c31-905d-a2f7728ff138","Type":"ContainerDied","Data":"edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f"} Nov 03 19:57:10.506372 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.506145 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-brl7b" event={"ID":"2185e83e-3a7c-4c31-905d-a2f7728ff138","Type":"ContainerDied","Data":"b5467ba7b88d81d8589bbae5a87bb4ba75e1684080b92e2e7f170ce62f01d4ab"} Nov 03 19:57:10.506372 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.506165 5024 scope.go:122] "RemoveContainer" containerID="edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f" Nov 03 19:57:10.514978 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.514944 5024 scope.go:122] "RemoveContainer" containerID="edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f" Nov 03 19:57:10.515210 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:57:10.515190 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f\": container with ID starting with edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f not found: ID does not exist" containerID="edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f" Nov 03 19:57:10.515271 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.515222 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f"} err="failed to get container status \"edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f\": rpc error: code = NotFound desc = could not find container \"edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f\": container with ID starting with edf63448a6eb7cf8bc77e4cba6a80231789955c1d9dbf53865ed86ba062faa5f not found: ID does not exist" Nov 03 19:57:10.671691 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.671657 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-brl7b"] Nov 03 19:57:10.678204 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:10.678183 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-brl7b"] Nov 03 19:57:12.334294 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:12.334267 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2185e83e-3a7c-4c31-905d-a2f7728ff138" path="/var/lib/kubelet/pods/2185e83e-3a7c-4c31-905d-a2f7728ff138/volumes" Nov 03 19:57:17.339170 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:17.339132 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:17.526433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:17.526404 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:17.966293 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:17.966261 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx"] Nov 03 19:57:17.966639 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:17.966627 5024 cpu_manager.go:414] "containerMap: removing container" podUID="2185e83e-3a7c-4c31-905d-a2f7728ff138" containerName="limitador" Nov 03 19:57:17.966679 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:17.966641 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2185e83e-3a7c-4c31-905d-a2f7728ff138" containerName="limitador" Nov 03 19:57:17.966712 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:17.966699 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="2185e83e-3a7c-4c31-905d-a2f7728ff138" containerName="limitador" Nov 03 19:57:17.969404 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:17.969387 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.026438 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.026415 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 03 19:57:18.026573 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.026494 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Nov 03 19:57:18.032172 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.032147 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx"] Nov 03 19:57:18.075293 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.075264 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:18.105308 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.105280 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg7kt\" (UniqueName: \"kubernetes.io/projected/12b72a14-0cc7-455a-8255-77e3d4a112bb-kube-api-access-qg7kt\") pod \"postgres-7cdbf6dc44-cs9mx\" (UID: \"12b72a14-0cc7-455a-8255-77e3d4a112bb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.105471 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.105437 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/12b72a14-0cc7-455a-8255-77e3d4a112bb-data\") pod \"postgres-7cdbf6dc44-cs9mx\" (UID: \"12b72a14-0cc7-455a-8255-77e3d4a112bb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.126559 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.126538 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 03 19:57:18.126688 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.126615 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-mnn9j\"" Nov 03 19:57:18.206497 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.206469 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg7kt\" (UniqueName: \"kubernetes.io/projected/12b72a14-0cc7-455a-8255-77e3d4a112bb-kube-api-access-qg7kt\") pod \"postgres-7cdbf6dc44-cs9mx\" (UID: \"12b72a14-0cc7-455a-8255-77e3d4a112bb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.206642 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.206537 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/12b72a14-0cc7-455a-8255-77e3d4a112bb-data\") pod \"postgres-7cdbf6dc44-cs9mx\" (UID: \"12b72a14-0cc7-455a-8255-77e3d4a112bb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.206918 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.206901 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/12b72a14-0cc7-455a-8255-77e3d4a112bb-data\") pod \"postgres-7cdbf6dc44-cs9mx\" (UID: \"12b72a14-0cc7-455a-8255-77e3d4a112bb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.267322 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.267268 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg7kt\" (UniqueName: \"kubernetes.io/projected/12b72a14-0cc7-455a-8255-77e3d4a112bb-kube-api-access-qg7kt\") pod \"postgres-7cdbf6dc44-cs9mx\" (UID: \"12b72a14-0cc7-455a-8255-77e3d4a112bb\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.281176 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.281159 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:18.653637 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:18.653612 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx"] Nov 03 19:57:18.655166 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:57:18.655137 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b72a14_0cc7_455a_8255_77e3d4a112bb.slice/crio-99a520cb67005537e3b20c041c66f4fefe40d831e7ce150f0948d32e62db4cea WatchSource:0}: Error finding container 99a520cb67005537e3b20c041c66f4fefe40d831e7ce150f0948d32e62db4cea: Status 404 returned error can't find the container with id 99a520cb67005537e3b20c041c66f4fefe40d831e7ce150f0948d32e62db4cea Nov 03 19:57:19.551693 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:19.551661 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" event={"ID":"12b72a14-0cc7-455a-8255-77e3d4a112bb","Type":"ContainerStarted","Data":"99a520cb67005537e3b20c041c66f4fefe40d831e7ce150f0948d32e62db4cea"} Nov 03 19:57:24.475487 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:24.475456 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-6hch7" Nov 03 19:57:25.587542 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:25.587508 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" event={"ID":"12b72a14-0cc7-455a-8255-77e3d4a112bb","Type":"ContainerStarted","Data":"90335d61c16e9f1e5ebddbaef6e05d6e580ca8759c239f9ce599bf3dd907a6e8"} Nov 03 19:57:25.587906 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:25.587695 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:25.703551 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:25.703507 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" podStartSLOduration=2.525010249 podStartE2EDuration="8.703494493s" totalImagesPullingTime="6.178484244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:57:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:57:25.701835084 +0000 UTC m=+393.483551751" watchObservedRunningTime="2026-11-03 19:57:25.703494493 +0000 UTC m=+393.485211158" Nov 03 19:57:31.625507 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:31.625473 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-cs9mx" Nov 03 19:57:32.199579 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:32.199489 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:32.411751 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:32.411719 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:32.598274 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:32.598194 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:34.264001 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.263967 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45"] Nov 03 19:57:34.316245 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.316210 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.326629 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.326606 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45"] Nov 03 19:57:34.373801 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.373771 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Nov 03 19:57:34.373801 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.373776 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"84daa8c4ed0405edc11b3a6589e0458f830ec2-28b1df78-dockercfg-fqnjg\"" Nov 03 19:57:34.373801 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.373780 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Nov 03 19:57:34.451694 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.451672 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.451803 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.451712 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.451803 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.451793 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnmc\" (UniqueName: \"kubernetes.io/projected/36e18497-6980-4712-ae45-1c9338122f69-kube-api-access-9mnmc\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.553019 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.552949 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnmc\" (UniqueName: \"kubernetes.io/projected/36e18497-6980-4712-ae45-1c9338122f69-kube-api-access-9mnmc\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.553148 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.553026 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.553148 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.553065 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.553453 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.553435 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-util\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.553514 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.553465 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-bundle\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.613469 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.613438 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnmc\" (UniqueName: \"kubernetes.io/projected/36e18497-6980-4712-ae45-1c9338122f69-kube-api-access-9mnmc\") pod \"84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:34.686818 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:34.686790 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:35.099319 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:35.099295 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45"] Nov 03 19:57:35.101295 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:57:35.101272 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e18497_6980_4712_ae45_1c9338122f69.slice/crio-814ec7f4fe77ef8ac428a7d45f4f05ac3bc6b79034cbe6d5afc324fa8445c46a WatchSource:0}: Error finding container 814ec7f4fe77ef8ac428a7d45f4f05ac3bc6b79034cbe6d5afc324fa8445c46a: Status 404 returned error can't find the container with id 814ec7f4fe77ef8ac428a7d45f4f05ac3bc6b79034cbe6d5afc324fa8445c46a Nov 03 19:57:35.640440 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:35.640406 5024 generic.go:356] "Generic (PLEG): container finished" podID="36e18497-6980-4712-ae45-1c9338122f69" containerID="a12ea2df51c27997bb09e0f2efe2558bb389cb999def9488ace1647f68da95a0" exitCode=0 Nov 03 19:57:35.640742 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:35.640485 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" event={"ID":"36e18497-6980-4712-ae45-1c9338122f69","Type":"ContainerDied","Data":"a12ea2df51c27997bb09e0f2efe2558bb389cb999def9488ace1647f68da95a0"} Nov 03 19:57:35.640742 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:35.640540 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" event={"ID":"36e18497-6980-4712-ae45-1c9338122f69","Type":"ContainerStarted","Data":"814ec7f4fe77ef8ac428a7d45f4f05ac3bc6b79034cbe6d5afc324fa8445c46a"} Nov 03 19:57:37.571264 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:57:37.571222 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:57:37.652718 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:37.652687 5024 generic.go:356] "Generic (PLEG): container finished" podID="36e18497-6980-4712-ae45-1c9338122f69" containerID="a5090db965490a75b31380fb20db5f328e8fa63bc378dd9fa2dcfae79a20ce5d" exitCode=0 Nov 03 19:57:37.652858 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:37.652777 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" event={"ID":"36e18497-6980-4712-ae45-1c9338122f69","Type":"ContainerDied","Data":"a5090db965490a75b31380fb20db5f328e8fa63bc378dd9fa2dcfae79a20ce5d"} Nov 03 19:57:38.662090 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:38.662054 5024 generic.go:356] "Generic (PLEG): container finished" podID="36e18497-6980-4712-ae45-1c9338122f69" containerID="74bc8dc7fc38daad949c33ded33c5a2ab698d7496880aff9c5fad3ec0c36218e" exitCode=0 Nov 03 19:57:38.662485 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:38.662141 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" event={"ID":"36e18497-6980-4712-ae45-1c9338122f69","Type":"ContainerDied","Data":"74bc8dc7fc38daad949c33ded33c5a2ab698d7496880aff9c5fad3ec0c36218e"} Nov 03 19:57:39.793874 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.793850 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:39.797062 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.797043 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-bundle\") pod \"36e18497-6980-4712-ae45-1c9338122f69\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " Nov 03 19:57:39.797154 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.797084 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-util\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-util\") pod \"36e18497-6980-4712-ae45-1c9338122f69\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " Nov 03 19:57:39.797154 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.797113 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36e18497-6980-4712-ae45-1c9338122f69-kube-api-access-9mnmc\" (UniqueName: \"kubernetes.io/projected/36e18497-6980-4712-ae45-1c9338122f69-kube-api-access-9mnmc\") pod \"36e18497-6980-4712-ae45-1c9338122f69\" (UID: \"36e18497-6980-4712-ae45-1c9338122f69\") " Nov 03 19:57:39.797568 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.797548 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-bundle" pod "36e18497-6980-4712-ae45-1c9338122f69" (UID: "36e18497-6980-4712-ae45-1c9338122f69"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:57:39.799412 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.799384 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e18497-6980-4712-ae45-1c9338122f69-kube-api-access-9mnmc" pod "36e18497-6980-4712-ae45-1c9338122f69" (UID: "36e18497-6980-4712-ae45-1c9338122f69"). InnerVolumeSpecName "kube-api-access-9mnmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:57:39.803302 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.803271 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-util" pod "36e18497-6980-4712-ae45-1c9338122f69" (UID: "36e18497-6980-4712-ae45-1c9338122f69"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 19:57:39.898073 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.898038 5024 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:57:39.898073 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.898066 5024 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36e18497-6980-4712-ae45-1c9338122f69-util\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:57:39.898073 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:39.898075 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mnmc\" (UniqueName: \"kubernetes.io/projected/36e18497-6980-4712-ae45-1c9338122f69-kube-api-access-9mnmc\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:57:40.675673 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:40.675634 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" event={"ID":"36e18497-6980-4712-ae45-1c9338122f69","Type":"ContainerDied","Data":"814ec7f4fe77ef8ac428a7d45f4f05ac3bc6b79034cbe6d5afc324fa8445c46a"} Nov 03 19:57:40.675673 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:40.675666 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/84daa8c4ed0405edc11b3a6589e0458f830ec24007ac2c176d3e46d08esnw45" Nov 03 19:57:40.675882 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:40.675692 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="814ec7f4fe77ef8ac428a7d45f4f05ac3bc6b79034cbe6d5afc324fa8445c46a" Nov 03 19:57:43.710620 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:43.710588 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:57:49.648619 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.648586 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dfdcb6669-4bf98"] Nov 03 19:57:49.649030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.648963 5024 cpu_manager.go:414] "containerMap: removing container" podUID="36e18497-6980-4712-ae45-1c9338122f69" containerName="extract" Nov 03 19:57:49.649030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.648977 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36e18497-6980-4712-ae45-1c9338122f69" containerName="extract" Nov 03 19:57:49.649030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.648991 5024 cpu_manager.go:414] "containerMap: removing container" podUID="36e18497-6980-4712-ae45-1c9338122f69" containerName="pull" Nov 03 19:57:49.649030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.648996 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36e18497-6980-4712-ae45-1c9338122f69" containerName="pull" Nov 03 19:57:49.649030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.649008 5024 cpu_manager.go:414] "containerMap: removing container" podUID="36e18497-6980-4712-ae45-1c9338122f69" containerName="util" Nov 03 19:57:49.649030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.649013 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36e18497-6980-4712-ae45-1c9338122f69" containerName="util" Nov 03 19:57:49.649237 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.649088 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="36e18497-6980-4712-ae45-1c9338122f69" containerName="extract" Nov 03 19:57:49.651052 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.651035 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" Nov 03 19:57:49.683662 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.683636 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp6k6\" (UniqueName: \"kubernetes.io/projected/0c143911-57c9-48e5-a18d-27846843e61d-kube-api-access-kp6k6\") pod \"keycloak-operator-dfdcb6669-4bf98\" (UID: \"0c143911-57c9-48e5-a18d-27846843e61d\") " pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" Nov 03 19:57:49.703378 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.703356 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Nov 03 19:57:49.752901 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.752872 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-5f2fh\"" Nov 03 19:57:49.753064 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.752921 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Nov 03 19:57:49.756503 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.756477 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dfdcb6669-4bf98"] Nov 03 19:57:49.784300 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.784264 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp6k6\" (UniqueName: \"kubernetes.io/projected/0c143911-57c9-48e5-a18d-27846843e61d-kube-api-access-kp6k6\") pod \"keycloak-operator-dfdcb6669-4bf98\" (UID: \"0c143911-57c9-48e5-a18d-27846843e61d\") " pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" Nov 03 19:57:49.853309 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.853284 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp6k6\" (UniqueName: \"kubernetes.io/projected/0c143911-57c9-48e5-a18d-27846843e61d-kube-api-access-kp6k6\") pod \"keycloak-operator-dfdcb6669-4bf98\" (UID: \"0c143911-57c9-48e5-a18d-27846843e61d\") " pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" Nov 03 19:57:49.963205 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:49.963120 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" Nov 03 19:57:50.337403 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:50.337379 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dfdcb6669-4bf98"] Nov 03 19:57:50.339119 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:57:50.339087 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c143911_57c9_48e5_a18d_27846843e61d.slice/crio-d99c394afc1ecdebbacf4d4831dbdb2c0f5f423e346391c83dac927b971cb373 WatchSource:0}: Error finding container d99c394afc1ecdebbacf4d4831dbdb2c0f5f423e346391c83dac927b971cb373: Status 404 returned error can't find the container with id d99c394afc1ecdebbacf4d4831dbdb2c0f5f423e346391c83dac927b971cb373 Nov 03 19:57:50.726810 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:50.726779 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" event={"ID":"0c143911-57c9-48e5-a18d-27846843e61d","Type":"ContainerStarted","Data":"d99c394afc1ecdebbacf4d4831dbdb2c0f5f423e346391c83dac927b971cb373"} Nov 03 19:57:56.764946 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:56.764883 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" event={"ID":"0c143911-57c9-48e5-a18d-27846843e61d","Type":"ContainerStarted","Data":"03518d35f45930a43dd4a90bb3bac13661bc2c413d8e9afcd6032a2a4605677d"} Nov 03 19:57:56.939502 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:57:56.939451 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dfdcb6669-4bf98" podStartSLOduration=2.522894259 podStartE2EDuration="7.939437662s" totalImagesPullingTime="5.416543403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:57:56.937499513 +0000 UTC m=+424.719216211" watchObservedRunningTime="2026-11-03 19:57:56.939437662 +0000 UTC m=+424.721154392" Nov 03 19:58:05.119119 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.119081 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:05.299259 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.299230 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:05.662457 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.662417 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:58:05.666315 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.666286 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:05.741830 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.741799 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp8jg\" (UniqueName: \"kubernetes.io/projected/7626f7a0-2235-45d2-ae2e-a938fe6497b2-kube-api-access-hp8jg\") pod \"maas-keycloak-0\" (UID: \"7626f7a0-2235-45d2-ae2e-a938fe6497b2\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:05.768024 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.767991 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Nov 03 19:58:05.768205 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.768087 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zxvjp\"" Nov 03 19:58:05.771445 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.771419 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:58:05.843406 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.843373 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp8jg\" (UniqueName: \"kubernetes.io/projected/7626f7a0-2235-45d2-ae2e-a938fe6497b2-kube-api-access-hp8jg\") pod \"maas-keycloak-0\" (UID: \"7626f7a0-2235-45d2-ae2e-a938fe6497b2\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:05.904618 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.904582 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp8jg\" (UniqueName: \"kubernetes.io/projected/7626f7a0-2235-45d2-ae2e-a938fe6497b2-kube-api-access-hp8jg\") pod \"maas-keycloak-0\" (UID: \"7626f7a0-2235-45d2-ae2e-a938fe6497b2\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:05.979901 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:05.979805 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:06.153678 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:06.153644 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:06.335715 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:06.335618 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:06.355748 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:06.355702 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:58:06.359222 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:58:06.359196 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7626f7a0_2235_45d2_ae2e_a938fe6497b2.slice/crio-4e9b2ff07738bc3eef80f017253da357368da3577f8b46e0d73ae695fd30b10d WatchSource:0}: Error finding container 4e9b2ff07738bc3eef80f017253da357368da3577f8b46e0d73ae695fd30b10d: Status 404 returned error can't find the container with id 4e9b2ff07738bc3eef80f017253da357368da3577f8b46e0d73ae695fd30b10d Nov 03 19:58:06.509613 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:06.509579 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:06.690537 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:06.690503 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:06.832736 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:06.832703 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7626f7a0-2235-45d2-ae2e-a938fe6497b2","Type":"ContainerStarted","Data":"4e9b2ff07738bc3eef80f017253da357368da3577f8b46e0d73ae695fd30b10d"} Nov 03 19:58:06.870479 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:06.870440 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:07.045106 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:07.045037 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:07.330425 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:07.330347 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:07.581190 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:58:07.581073 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:58:08.394348 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:08.394310 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:11.864972 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:11.864917 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7626f7a0-2235-45d2-ae2e-a938fe6497b2","Type":"ContainerStarted","Data":"3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645"} Nov 03 19:58:11.980006 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:11.979965 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:11.982194 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:11.982158 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:11.983659 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:11.983618 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.9996815730000002 podStartE2EDuration="6.983605887s" totalImagesPullingTime="4.983924314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:58:11.981757868 +0000 UTC m=+439.763474534" watchObservedRunningTime="2026-11-03 19:58:11.983605887 +0000 UTC m=+439.765322547" Nov 03 19:58:12.980940 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:12.980866 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:13.594264 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:13.594134 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:13.779699 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:13.779668 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:13.967458 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:13.967415 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:13.980624 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:13.980578 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:14.171269 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:14.171224 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:14.371985 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:14.371882 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:14.555042 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:14.555006 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:14.746998 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:14.746963 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:14.980323 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:14.980284 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:15.980947 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:15.980879 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:15.981899 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:15.980886 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:16.981152 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:16.981104 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:17.980369 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:17.980323 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:18.980433 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:18.980386 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:19.980793 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:19.980752 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:20.980957 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:20.980889 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:21.980277 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:21.980237 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:22.981149 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:22.981111 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:23.981055 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:23.981006 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:24.980975 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:24.980912 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:25.981171 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:25.981068 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.50:9000/health/started\": dial tcp 10.132.0.50:9000: connect: connection refused" Nov 03 19:58:27.121636 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:27.121602 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:27.169563 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:27.169225 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 19:58:37.127743 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:37.127708 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Nov 03 19:58:37.570393 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:58:37.570356 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:58:44.056449 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:44.056411 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:44.681334 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:44.681305 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:44.857453 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:44.857424 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:45.042201 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:45.042117 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:45.224895 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:45.224864 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:52.663850 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:52.663820 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:52.840090 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:52.840060 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:54.162551 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:54.162517 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:54.350093 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:54.350061 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:56.289578 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:56.289540 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:58:56.503298 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:58:56.503224 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:06.096604 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.096568 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": read tcp 10.132.0.2:52202->10.132.0.34:15021: read: connection reset by peer" start-of-body= Nov 03 19:59:06.097073 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.096633 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podUID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": read tcp 10.132.0.2:52202->10.132.0.34:15021: read: connection reset by peer" Nov 03 19:59:06.226575 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.226547 5024 generic.go:356] "Generic (PLEG): container finished" podID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerID="73f7590d582b1b4a453d57cc7a6e60f73510423cb877110bd547e1c86a99aa51" exitCode=0 Nov 03 19:59:06.226690 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.226586 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" event={"ID":"f6f75017-0a57-4f8c-b105-c8434fc35780","Type":"ContainerDied","Data":"73f7590d582b1b4a453d57cc7a6e60f73510423cb877110bd547e1c86a99aa51"} Nov 03 19:59:06.226978 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.226963 5024 scope.go:122] "RemoveContainer" containerID="73f7590d582b1b4a453d57cc7a6e60f73510423cb877110bd547e1c86a99aa51" Nov 03 19:59:06.228020 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.227993 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:59:06.228081 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.228062 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:59:06.228124 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:06.228093 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 19:59:07.233957 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:07.233907 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" event={"ID":"f6f75017-0a57-4f8c-b105-c8434fc35780","Type":"ContainerStarted","Data":"737cacecabab89960f7f028fe730c5ed4125f989d58349a1892dbc9acb1981fb"} Nov 03 19:59:07.590066 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:59:07.589973 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:59:08.146937 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:08.146891 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:59:08.147192 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:08.147157 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 03 19:59:08.147237 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:08.147203 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podUID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 03 19:59:09.146479 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:09.146444 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 03 19:59:09.146879 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:09.146496 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podUID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 03 19:59:10.146614 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:10.146583 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 03 19:59:10.147030 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:10.146635 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podUID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 03 19:59:11.146731 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:11.146695 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 03 19:59:11.147231 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:11.146754 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podUID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 03 19:59:12.149383 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:12.149353 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:59:12.149854 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:12.149722 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:59:12.150317 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:12.150299 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" Nov 03 19:59:22.776763 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:22.776721 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:22.958137 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:22.958106 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:24.860664 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:24.860633 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:25.042662 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:25.042616 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:25.223736 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:25.223704 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:25.401290 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:25.401258 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:37.572563 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:59:37.572528 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 19:59:41.165059 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:41.165022 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:41.407875 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:41.407844 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:44.397671 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:44.397630 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 19:59:46.802021 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:46.801979 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:59:46.802403 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:46.802242 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" containerID="cri-o://3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645" gracePeriod=30 Nov 03 19:59:47.127059 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:47.126967 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 19:59:48.441035 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.441000 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:48.446406 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.446381 5024 generic.go:356] "Generic (PLEG): container finished" podID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerID="3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645" exitCode=143 Nov 03 19:59:48.446534 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.446415 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:48.446534 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.446465 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7626f7a0-2235-45d2-ae2e-a938fe6497b2","Type":"ContainerDied","Data":"3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645"} Nov 03 19:59:48.446534 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.446524 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7626f7a0-2235-45d2-ae2e-a938fe6497b2","Type":"ContainerDied","Data":"4e9b2ff07738bc3eef80f017253da357368da3577f8b46e0d73ae695fd30b10d"} Nov 03 19:59:48.446690 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.446550 5024 scope.go:122] "RemoveContainer" containerID="3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645" Nov 03 19:59:48.455988 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.455973 5024 scope.go:122] "RemoveContainer" containerID="3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645" Nov 03 19:59:48.456266 ip-10-0-131-64 kubenswrapper[5024]: E1103 19:59:48.456249 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645\": container with ID starting with 3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645 not found: ID does not exist" containerID="3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645" Nov 03 19:59:48.456313 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.456277 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645"} err="failed to get container status \"3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645\": rpc error: code = NotFound desc = could not find container \"3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645\": container with ID starting with 3ed7b2c9665ef561ca5a42b02a153634612c990422190cba01cc7cb5336cd645 not found: ID does not exist" Nov 03 19:59:48.478289 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.478244 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7626f7a0-2235-45d2-ae2e-a938fe6497b2-kube-api-access-hp8jg\" (UniqueName: \"kubernetes.io/projected/7626f7a0-2235-45d2-ae2e-a938fe6497b2-kube-api-access-hp8jg\") pod \"7626f7a0-2235-45d2-ae2e-a938fe6497b2\" (UID: \"7626f7a0-2235-45d2-ae2e-a938fe6497b2\") " Nov 03 19:59:48.480298 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.480274 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7626f7a0-2235-45d2-ae2e-a938fe6497b2-kube-api-access-hp8jg" pod "7626f7a0-2235-45d2-ae2e-a938fe6497b2" (UID: "7626f7a0-2235-45d2-ae2e-a938fe6497b2"). InnerVolumeSpecName "kube-api-access-hp8jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 19:59:48.579107 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.579074 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp8jg\" (UniqueName: \"kubernetes.io/projected/7626f7a0-2235-45d2-ae2e-a938fe6497b2-kube-api-access-hp8jg\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 19:59:48.867687 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.867661 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:59:48.871846 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.871824 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:59:48.895691 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.895668 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:59:48.896031 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.896019 5024 cpu_manager.go:414] "containerMap: removing container" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" Nov 03 19:59:48.896075 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.896032 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" Nov 03 19:59:48.896118 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.896109 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" containerName="keycloak" Nov 03 19:59:48.900480 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.900459 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:48.952933 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.952908 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Nov 03 19:59:48.953160 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.953137 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zxvjp\"" Nov 03 19:59:48.953260 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.953248 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Nov 03 19:59:48.983298 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.983270 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4tmz\" (UniqueName: \"kubernetes.io/projected/efac2c20-30cb-46fc-8082-2d6f4eba25eb-kube-api-access-f4tmz\") pod \"maas-keycloak-0\" (UID: \"efac2c20-30cb-46fc-8082-2d6f4eba25eb\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:48.983411 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.983344 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/efac2c20-30cb-46fc-8082-2d6f4eba25eb-test-realms\") pod \"maas-keycloak-0\" (UID: \"efac2c20-30cb-46fc-8082-2d6f4eba25eb\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:48.983759 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:48.983733 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:59:49.084815 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:49.084740 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/efac2c20-30cb-46fc-8082-2d6f4eba25eb-test-realms\") pod \"maas-keycloak-0\" (UID: \"efac2c20-30cb-46fc-8082-2d6f4eba25eb\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:49.084815 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:49.084798 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4tmz\" (UniqueName: \"kubernetes.io/projected/efac2c20-30cb-46fc-8082-2d6f4eba25eb-kube-api-access-f4tmz\") pod \"maas-keycloak-0\" (UID: \"efac2c20-30cb-46fc-8082-2d6f4eba25eb\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:49.085422 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:49.085403 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/efac2c20-30cb-46fc-8082-2d6f4eba25eb-test-realms\") pod \"maas-keycloak-0\" (UID: \"efac2c20-30cb-46fc-8082-2d6f4eba25eb\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:49.145951 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:49.145899 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4tmz\" (UniqueName: \"kubernetes.io/projected/efac2c20-30cb-46fc-8082-2d6f4eba25eb-kube-api-access-f4tmz\") pod \"maas-keycloak-0\" (UID: \"efac2c20-30cb-46fc-8082-2d6f4eba25eb\") " pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:49.212160 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:49.212119 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:49.585779 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:49.585753 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Nov 03 19:59:49.587163 ip-10-0-131-64 kubenswrapper[5024]: W1103 19:59:49.587138 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefac2c20_30cb_46fc_8082_2d6f4eba25eb.slice/crio-91cc8ea3c5beaed37030445e49a88f6132cb00270ab2bb5f38de14ab5a44197d WatchSource:0}: Error finding container 91cc8ea3c5beaed37030445e49a88f6132cb00270ab2bb5f38de14ab5a44197d: Status 404 returned error can't find the container with id 91cc8ea3c5beaed37030445e49a88f6132cb00270ab2bb5f38de14ab5a44197d Nov 03 19:59:50.333814 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:50.333779 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7626f7a0-2235-45d2-ae2e-a938fe6497b2" path="/var/lib/kubelet/pods/7626f7a0-2235-45d2-ae2e-a938fe6497b2/volumes" Nov 03 19:59:50.458629 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:50.458604 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"efac2c20-30cb-46fc-8082-2d6f4eba25eb","Type":"ContainerStarted","Data":"91cc8ea3c5beaed37030445e49a88f6132cb00270ab2bb5f38de14ab5a44197d"} Nov 03 19:59:51.468852 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:51.468809 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"efac2c20-30cb-46fc-8082-2d6f4eba25eb","Type":"ContainerStarted","Data":"2d2493b27257be1a7d65a7cb9779a1fd23bd514758051dbb717ff496c48df37b"} Nov 03 19:59:51.588072 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:51.588006 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.744265308 podStartE2EDuration="3.587982178s" totalImagesPullingTime="843.71687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 19:59:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 19:59:51.586647136 +0000 UTC m=+539.368363804" watchObservedRunningTime="2026-11-03 19:59:51.587982178 +0000 UTC m=+539.369698844" Nov 03 19:59:52.212663 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:52.212619 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:52.213918 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:52.213881 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 19:59:53.212960 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:53.212892 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 19:59:54.212894 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:54.212848 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 19:59:55.215588 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:55.215543 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 19:59:56.213285 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:56.213244 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 19:59:57.212662 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:57.212613 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 19:59:58.213560 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:58.213507 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 19:59:59.212968 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:59.212903 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Nov 03 19:59:59.213335 ip-10-0-131-64 kubenswrapper[5024]: I1103 19:59:59.213302 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 20:00:00.213076 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:00.213036 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 20:00:01.213355 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:01.213307 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 20:00:02.212517 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:02.212472 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 20:00:03.213121 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:03.213068 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 20:00:04.212598 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:04.212552 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 20:00:05.213616 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:05.213567 5024 prober.go:122] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.51:9000/health/started\": dial tcp 10.132.0.51:9000: connect: connection refused" Nov 03 20:00:06.389863 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:06.388830 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Nov 03 20:00:06.410720 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:06.410672 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="efac2c20-30cb-46fc-8082-2d6f4eba25eb" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 20:00:07.583736 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:00:07.583690 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:00:16.394845 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:16.394817 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Nov 03 20:00:23.052996 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:23.052960 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:00:37.571117 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:00:37.571042 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:00:44.697005 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:44.696967 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:00:52.557398 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:52.557366 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 20:00:52.557963 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:52.557947 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 20:00:52.561057 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:52.561032 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 20:00:52.561761 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:00:52.561746 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 20:01:07.575882 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:01:07.575833 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:01:16.255140 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:16.255101 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:16.485408 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:16.485375 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:16.922467 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:16.922437 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:27.201353 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:27.201308 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:27.379727 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:27.379685 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:37.375703 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:37.375664 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:37.573508 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:01:37.573471 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:01:43.658610 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:43.658580 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:45.082632 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:45.082592 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:49.491502 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:49.491465 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:49.973572 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:49.973542 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:51.231559 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:51.231520 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:51.416231 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:51.416196 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:57.721276 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:57.721224 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:01:59.370838 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:01:59.370794 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:04.884573 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:04.884486 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:07.572383 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:02:07.572349 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:02:07.850881 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.850782 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc"] Nov 03 20:02:07.854491 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.854473 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:07.907025 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.906986 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 03 20:02:07.931328 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.931291 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 03 20:02:07.931328 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.931291 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6mwnm\"" Nov 03 20:02:07.940813 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.940772 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:07.940985 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.940821 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:07.940985 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.940916 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxkf6\" (UniqueName: \"kubernetes.io/projected/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-kube-api-access-hxkf6\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:07.941069 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.941020 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:07.941111 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.941087 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:07.941180 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.941167 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:07.956561 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.956531 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Nov 03 20:02:07.963675 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.961494 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc"] Nov 03 20:02:07.981079 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:07.981042 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:08.042190 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042150 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042230 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042251 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042267 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042290 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxkf6\" (UniqueName: \"kubernetes.io/projected/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-kube-api-access-hxkf6\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042334 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042703 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042677 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042831 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042773 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.042831 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.042779 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.044785 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.044765 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.044972 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.044954 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.104016 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.103909 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxkf6\" (UniqueName: \"kubernetes.io/projected/c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0-kube-api-access-hxkf6\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ttrwc\" (UID: \"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.168241 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.168199 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:08.553807 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.553779 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc"] Nov 03 20:02:08.555684 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:02:08.555653 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a2e45d_cfdb_436c_b7fd_8f3fc3011bf0.slice/crio-c6d7a661dfef4943602682889530ac0dd4276ca212bc9ef3ee7b6cda566386e0 WatchSource:0}: Error finding container c6d7a661dfef4943602682889530ac0dd4276ca212bc9ef3ee7b6cda566386e0: Status 404 returned error can't find the container with id c6d7a661dfef4943602682889530ac0dd4276ca212bc9ef3ee7b6cda566386e0 Nov 03 20:02:08.557041 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:08.557019 5024 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:02:09.261443 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:09.261407 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" event={"ID":"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0","Type":"ContainerStarted","Data":"c6d7a661dfef4943602682889530ac0dd4276ca212bc9ef3ee7b6cda566386e0"} Nov 03 20:02:10.271133 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:10.271096 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" event={"ID":"c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0","Type":"ContainerStarted","Data":"8772e82a1b96ae161d9daa127e4cf9214ad2c81280d28f9d172f2c5ceb4f1121"} Nov 03 20:02:10.389010 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:10.388915 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" podStartSLOduration=1.805220296 podStartE2EDuration="3.388897328s" totalImagesPullingTime="1.583677032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:10.388316431 +0000 UTC m=+678.170033123" watchObservedRunningTime="2026-11-03 20:02:10.388897328 +0000 UTC m=+678.170613997" Nov 03 20:02:11.153566 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:11.153532 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:11.169381 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:11.169349 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:14.946490 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:14.946454 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5"] Nov 03 20:02:14.950236 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:14.950210 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.052080 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.052043 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Nov 03 20:02:15.054558 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.054526 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5"] Nov 03 20:02:15.075587 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.075554 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:15.107763 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.107728 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af09eb54-4791-4d4c-bb1e-59ea69a00413-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.107763 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.107767 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.108035 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.107810 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.108035 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.107880 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.108035 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.108002 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.108035 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.108023 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtzv4\" (UniqueName: \"kubernetes.io/projected/af09eb54-4791-4d4c-bb1e-59ea69a00413-kube-api-access-mtzv4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209136 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209048 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtzv4\" (UniqueName: \"kubernetes.io/projected/af09eb54-4791-4d4c-bb1e-59ea69a00413-kube-api-access-mtzv4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209136 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209120 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af09eb54-4791-4d4c-bb1e-59ea69a00413-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209398 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209271 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209398 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209337 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209398 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209354 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209398 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209383 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209660 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209639 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209747 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209726 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.209825 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.209792 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.211684 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.211668 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af09eb54-4791-4d4c-bb1e-59ea69a00413-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.211848 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.211831 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af09eb54-4791-4d4c-bb1e-59ea69a00413-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.270053 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.270026 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtzv4\" (UniqueName: \"kubernetes.io/projected/af09eb54-4791-4d4c-bb1e-59ea69a00413-kube-api-access-mtzv4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5\" (UID: \"af09eb54-4791-4d4c-bb1e-59ea69a00413\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.563907 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.563817 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:15.942761 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:15.942733 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5"] Nov 03 20:02:15.944811 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:02:15.944782 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf09eb54_4791_4d4c_bb1e_59ea69a00413.slice/crio-6bcf45250090230b7510e698619bd6d904fdd1feffd4ea0ad131c42479be8c1c WatchSource:0}: Error finding container 6bcf45250090230b7510e698619bd6d904fdd1feffd4ea0ad131c42479be8c1c: Status 404 returned error can't find the container with id 6bcf45250090230b7510e698619bd6d904fdd1feffd4ea0ad131c42479be8c1c Nov 03 20:02:16.304891 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:16.304796 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" event={"ID":"af09eb54-4791-4d4c-bb1e-59ea69a00413","Type":"ContainerStarted","Data":"6bcf45250090230b7510e698619bd6d904fdd1feffd4ea0ad131c42479be8c1c"} Nov 03 20:02:17.312065 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:17.312024 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" event={"ID":"af09eb54-4791-4d4c-bb1e-59ea69a00413","Type":"ContainerStarted","Data":"2f94b4a3cb0680089ae58dc088bc6ad44d52ace072e640e89603c029527c3fc7"} Nov 03 20:02:17.432109 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:17.432041 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" podStartSLOduration=2.827415764 podStartE2EDuration="3.432019787s" totalImagesPullingTime="604.604023ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:17.429772298 +0000 UTC m=+685.211488965" watchObservedRunningTime="2026-11-03 20:02:17.432019787 +0000 UTC m=+685.213736455" Nov 03 20:02:17.564566 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:17.564471 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:18.162980 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:18.162914 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:18.168879 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:18.168844 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:18.182743 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:18.182715 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:18.335000 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:18.334967 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ttrwc" Nov 03 20:02:21.892588 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.892555 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t"] Nov 03 20:02:21.896356 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.896339 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:21.968369 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.968338 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Nov 03 20:02:21.975900 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.975873 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:21.976041 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.975907 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:21.976087 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.976042 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:21.976136 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.976092 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl2b9\" (UniqueName: \"kubernetes.io/projected/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-kube-api-access-tl2b9\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:21.976214 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.976199 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:21.976277 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:21.976241 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.000528 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.000497 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t"] Nov 03 20:02:22.014534 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.014504 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:22.077297 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077262 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077465 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077307 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077465 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077366 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077465 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077380 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077465 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077409 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077465 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077447 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl2b9\" (UniqueName: \"kubernetes.io/projected/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-kube-api-access-tl2b9\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077789 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077767 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077892 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077798 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.077892 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.077836 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.079792 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.079771 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.080070 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.080052 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.139060 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.139025 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl2b9\" (UniqueName: \"kubernetes.io/projected/4c0d42b4-24ee-4f91-81cb-e262e9fb24ae-kube-api-access-tl2b9\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t\" (UID: \"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.209090 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.208995 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:22.586689 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:22.586662 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t"] Nov 03 20:02:22.588209 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:02:22.588185 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0d42b4_24ee_4f91_81cb_e262e9fb24ae.slice/crio-b0b1b6424a35de7936fe94e6c1e2c601a095f3b71a3609ae3a9d9bcacdaae8c0 WatchSource:0}: Error finding container b0b1b6424a35de7936fe94e6c1e2c601a095f3b71a3609ae3a9d9bcacdaae8c0: Status 404 returned error can't find the container with id b0b1b6424a35de7936fe94e6c1e2c601a095f3b71a3609ae3a9d9bcacdaae8c0 Nov 03 20:02:23.349746 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:23.349709 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" event={"ID":"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae","Type":"ContainerStarted","Data":"5e144bccde2a48b328da5f2de5708558b100d50f50c3405b0337b61257df3de6"} Nov 03 20:02:23.350147 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:23.349760 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" event={"ID":"4c0d42b4-24ee-4f91-81cb-e262e9fb24ae","Type":"ContainerStarted","Data":"b0b1b6424a35de7936fe94e6c1e2c601a095f3b71a3609ae3a9d9bcacdaae8c0"} Nov 03 20:02:23.467021 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:23.466675 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" podStartSLOduration=1.8499017229999999 podStartE2EDuration="2.466656367s" totalImagesPullingTime="616.754644ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:23.466194533 +0000 UTC m=+691.247911199" watchObservedRunningTime="2026-11-03 20:02:23.466656367 +0000 UTC m=+691.248373033" Nov 03 20:02:24.209382 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:24.209349 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:25.564573 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:25.564541 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:25.582970 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:25.582919 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:25.583940 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:25.583907 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:26.383417 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:26.383380 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5" Nov 03 20:02:32.210143 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:32.210101 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:32.223089 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:32.223070 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:32.424016 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:32.423987 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t" Nov 03 20:02:37.571473 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:02:37.571439 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:02:45.430483 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:45.430447 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:55.316014 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.315985 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx"] Nov 03 20:02:55.321485 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.321463 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.414272 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.414226 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx"] Nov 03 20:02:55.474325 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474293 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474325 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474326 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92n74\" (UniqueName: \"kubernetes.io/projected/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-kube-api-access-92n74\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474559 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474356 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474559 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474457 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474559 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474489 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474559 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474507 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474559 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474523 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474574 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.474802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.474654 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.575853 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.575779 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.575853 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.575810 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92n74\" (UniqueName: \"kubernetes.io/projected/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-kube-api-access-92n74\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.575853 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.575833 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.575958 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576007 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576035 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576060 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576278 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576083 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576278 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576203 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576278 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576242 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576458 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576286 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576458 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576285 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576525 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576509 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.576767 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.576747 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.578484 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.578456 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.578628 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.578614 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.636330 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.636303 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.636493 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.636474 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92n74\" (UniqueName: \"kubernetes.io/projected/40cca8d5-0ecc-48f9-a56b-d46cd2359f4f-kube-api-access-92n74\") pod \"maas-default-gateway-openshift-default-59f957fdd7-xj5qx\" (UID: \"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:55.935248 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:55.935213 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:56.361491 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.361466 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx"] Nov 03 20:02:56.363482 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:02:56.363458 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40cca8d5_0ecc_48f9_a56b_d46cd2359f4f.slice/crio-5d7f02a67293046599ded158cac2177da7c600fd02247d66ce49381bd6c4f7e2 WatchSource:0}: Error finding container 5d7f02a67293046599ded158cac2177da7c600fd02247d66ce49381bd6c4f7e2: Status 404 returned error can't find the container with id 5d7f02a67293046599ded158cac2177da7c600fd02247d66ce49381bd6c4f7e2 Nov 03 20:02:56.365548 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.365513 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:02:56.365629 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.365576 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:02:56.365629 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.365603 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:02:56.545744 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.545709 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" event={"ID":"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f","Type":"ContainerStarted","Data":"ba83c638e8d4b2a85c3c7019d306d0ea22c0a4d8b4a65710752fd28eb5f19e9d"} Nov 03 20:02:56.545943 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.545758 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" event={"ID":"40cca8d5-0ecc-48f9-a56b-d46cd2359f4f","Type":"ContainerStarted","Data":"5d7f02a67293046599ded158cac2177da7c600fd02247d66ce49381bd6c4f7e2"} Nov 03 20:02:56.589835 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.589811 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:56.670635 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.670577 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podStartSLOduration=1.670561294 podStartE2EDuration="1.670561294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:02:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:02:56.668356715 +0000 UTC m=+724.450073381" watchObservedRunningTime="2026-11-03 20:02:56.670561294 +0000 UTC m=+724.452277959" Nov 03 20:02:56.773789 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.773757 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:56.935473 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:56.935392 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:02:57.937312 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:57.937282 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 20:02:57.937674 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:57.937328 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 20:02:58.153807 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:58.153769 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:58.344486 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:58.344408 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:02:58.936511 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:58.936478 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 20:02:58.936679 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:58.936549 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 20:02:59.936047 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:59.935985 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 20:02:59.936518 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:02:59.936103 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 20:03:00.936258 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:00.936222 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 20:03:00.936765 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:00.936284 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 20:03:01.935908 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:01.935872 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 20:03:01.936128 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:01.935937 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 20:03:02.935532 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:02.935500 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 03 20:03:02.936040 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:02.935559 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 03 20:03:04.642426 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:04.642394 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:03:04.643094 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:04.643074 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:03:04.643803 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:04.643784 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" Nov 03 20:03:07.571223 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:03:07.571190 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:03:32.374739 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:32.374654 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:03:37.571531 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:03:37.571488 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:03:45.793543 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:45.793509 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:03:50.873315 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:50.873284 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:03:55.927708 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:55.927673 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx"] Nov 03 20:03:55.931191 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:55.931176 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:55.983715 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:55.983690 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"grid-inv-b695bb2e-unmatched-kserve-self-signed-certs\"" Nov 03 20:03:56.028527 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.028489 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-model-cache\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.028686 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.028531 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m7ds\" (UniqueName: \"kubernetes.io/projected/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-kube-api-access-4m7ds\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.028686 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.028555 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-dshm\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.028686 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.028665 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tls-certs\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.028786 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.028693 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-home\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.028842 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.028826 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tmp-dir\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.035299 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.035281 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx"] Nov 03 20:03:56.054657 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.054632 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:03:56.130020 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.129990 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tmp-dir\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130215 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130042 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-model-cache\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130215 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130062 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m7ds\" (UniqueName: \"kubernetes.io/projected/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-kube-api-access-4m7ds\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130215 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130077 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-dshm\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130215 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130109 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tls-certs\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130215 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130125 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-home\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130521 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130481 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tmp-dir\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130521 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130489 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-model-cache\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.130597 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.130548 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-home\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.132502 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.132471 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-dshm\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.132735 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.132717 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tls-certs\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.191771 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.191702 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m7ds\" (UniqueName: \"kubernetes.io/projected/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-kube-api-access-4m7ds\") pod \"grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.252057 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.252022 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:03:56.632635 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.632611 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx"] Nov 03 20:03:56.633795 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:03:56.633772 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa43baa3_7a61_44b9_9abd_061f3fbf6e3f.slice/crio-e02cd1d4537ee5770df3411ec8afedf474a7d10a9624cb2f2724094ab7f89318 WatchSource:0}: Error finding container e02cd1d4537ee5770df3411ec8afedf474a7d10a9624cb2f2724094ab7f89318: Status 404 returned error can't find the container with id e02cd1d4537ee5770df3411ec8afedf474a7d10a9624cb2f2724094ab7f89318 Nov 03 20:03:56.898166 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.898128 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" event={"ID":"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f","Type":"ContainerStarted","Data":"e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5"} Nov 03 20:03:56.898335 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:56.898177 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" event={"ID":"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f","Type":"ContainerStarted","Data":"e02cd1d4537ee5770df3411ec8afedf474a7d10a9624cb2f2724094ab7f89318"} Nov 03 20:03:57.016520 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:57.016473 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" podStartSLOduration=2.016459001 podStartE2EDuration="2.016459001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:03:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:03:57.01515464 +0000 UTC m=+784.796871307" watchObservedRunningTime="2026-11-03 20:03:57.016459001 +0000 UTC m=+784.798175667" Nov 03 20:03:57.252167 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:03:57.252090 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:04:06.252167 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:06.252133 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:04:06.264566 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:06.264541 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:04:06.965256 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:06.965227 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:04:07.574172 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:04:07.574132 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:04:10.929485 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.929456 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng"] Nov 03 20:04:10.933035 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.933012 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.979186 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.979161 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks"] Nov 03 20:04:10.980837 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.980818 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.980966 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.980855 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83837dc2-b70c-4109-9327-6bdfb43a9d71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.980966 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.980890 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.981045 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.981024 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.981082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.981057 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.981114 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.981084 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.981145 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.981132 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.981177 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.981160 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.981211 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.981182 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7cfp\" (UniqueName: \"kubernetes.io/projected/83837dc2-b70c-4109-9327-6bdfb43a9d71-kube-api-access-j7cfp\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:10.982578 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:10.982562 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.035534 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.035506 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng"] Nov 03 20:04:11.081824 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.081797 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082021 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.081832 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082021 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.081865 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082021 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.081986 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7cfp\" (UniqueName: \"kubernetes.io/projected/83837dc2-b70c-4109-9327-6bdfb43a9d71-kube-api-access-j7cfp\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082031 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082050 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082091 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89mw\" (UniqueName: \"kubernetes.io/projected/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-kube-api-access-r89mw\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082113 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83837dc2-b70c-4109-9327-6bdfb43a9d71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082136 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082433 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082253 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082433 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082278 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082433 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082320 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082433 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082354 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082433 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082386 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082695 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082429 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082695 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082435 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082695 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082463 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.082695 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082505 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082695 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082530 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082960 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082711 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082960 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082734 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83837dc2-b70c-4109-9327-6bdfb43a9d71-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.082960 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.082845 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.083269 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.083076 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.084415 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.084396 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.084983 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.084961 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.094734 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.094702 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks"] Nov 03 20:04:11.143201 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.143170 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83837dc2-b70c-4109-9327-6bdfb43a9d71-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.143339 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.143277 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7cfp\" (UniqueName: \"kubernetes.io/projected/83837dc2-b70c-4109-9327-6bdfb43a9d71-kube-api-access-j7cfp\") pod \"maas-default-gateway-openshift-default-59f957fdd7-gvnng\" (UID: \"83837dc2-b70c-4109-9327-6bdfb43a9d71\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.182951 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.182873 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.182951 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.182907 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183142 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.182960 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183142 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183046 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183259 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183144 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183259 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183194 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89mw\" (UniqueName: \"kubernetes.io/projected/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-kube-api-access-r89mw\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183259 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183234 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183418 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183269 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183418 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183294 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183418 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183306 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-workload-certs\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183418 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183366 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-credential-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.183906 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183887 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.184014 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.183908 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-workload-socket\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.184063 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.184041 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-data\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.185385 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.185369 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.185578 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.185558 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-envoy\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.244176 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.244148 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-istio-token\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.244176 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.244166 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89mw\" (UniqueName: \"kubernetes.io/projected/dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9-kube-api-access-r89mw\") pod \"maas-default-gateway-openshift-default-59f957fdd7-n79ks\" (UID: \"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.246063 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.246047 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:11.294786 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.294724 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:11.671067 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.671044 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng"] Nov 03 20:04:11.671715 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:04:11.671691 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83837dc2_b70c_4109_9327_6bdfb43a9d71.slice/crio-3d401278765de029ebaa57e525da7694e30d012fed8b3963d85988c48fb6fcbc WatchSource:0}: Error finding container 3d401278765de029ebaa57e525da7694e30d012fed8b3963d85988c48fb6fcbc: Status 404 returned error can't find the container with id 3d401278765de029ebaa57e525da7694e30d012fed8b3963d85988c48fb6fcbc Nov 03 20:04:11.673762 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.673733 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:04:11.673858 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.673803 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:04:11.673858 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.673846 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:04:11.723057 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.723037 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks"] Nov 03 20:04:11.723470 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:04:11.723450 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2ca20d_c22b_491f_a7f7_b8ea6c8673f9.slice/crio-e97535db4e3148d558da11905a3335019fdd46c7bfd1c7fdf9c0d4d5c224bf2c WatchSource:0}: Error finding container e97535db4e3148d558da11905a3335019fdd46c7bfd1c7fdf9c0d4d5c224bf2c: Status 404 returned error can't find the container with id e97535db4e3148d558da11905a3335019fdd46c7bfd1c7fdf9c0d4d5c224bf2c Nov 03 20:04:11.725434 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.725408 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:04:11.725493 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.725466 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:04:11.725532 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.725493 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:04:11.986298 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.986208 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" event={"ID":"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9","Type":"ContainerStarted","Data":"5d880897d0d80bbfaf13233ed991626bb268c12b54a914d439567c304de02346"} Nov 03 20:04:11.986298 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.986276 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" event={"ID":"dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9","Type":"ContainerStarted","Data":"e97535db4e3148d558da11905a3335019fdd46c7bfd1c7fdf9c0d4d5c224bf2c"} Nov 03 20:04:11.988096 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.988066 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" event={"ID":"83837dc2-b70c-4109-9327-6bdfb43a9d71","Type":"ContainerStarted","Data":"aef09dabaada143d9ebd72a38075fc95d148d8981e831888d348e6f93991a129"} Nov 03 20:04:11.988227 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:11.988108 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" event={"ID":"83837dc2-b70c-4109-9327-6bdfb43a9d71","Type":"ContainerStarted","Data":"3d401278765de029ebaa57e525da7694e30d012fed8b3963d85988c48fb6fcbc"} Nov 03 20:04:12.106831 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.106776 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podStartSLOduration=2.106762155 podStartE2EDuration="2.106762155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:04:12.105716582 +0000 UTC m=+799.887433253" watchObservedRunningTime="2026-11-03 20:04:12.106762155 +0000 UTC m=+799.888478893" Nov 03 20:04:12.247044 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.246964 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:12.248257 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.248229 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:12.248401 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.248273 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:12.297350 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.297315 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:12.303446 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.303413 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:12.303720 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.303695 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:12.941761 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:12.941720 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:04:13.130962 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:13.130918 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:04:13.246825 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:13.246731 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:13.246825 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:13.246787 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:13.300318 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:13.300279 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:13.300575 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:13.300549 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:14.247453 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:14.247414 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:14.248008 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:14.247479 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:14.296310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:14.296275 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:14.296588 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:14.296561 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:15.247024 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:15.246993 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:15.247184 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:15.247041 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:15.302310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:15.302274 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:15.303048 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:15.303011 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:16.246709 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:16.246675 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:16.246867 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:16.246726 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:16.299296 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:16.299259 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:16.299563 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:16.299533 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:17.247225 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:17.247197 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:17.247681 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:17.247655 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:17.299306 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:17.299273 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:17.299563 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:17.299535 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:18.246334 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:18.246296 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:18.246509 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:18.246355 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:18.296185 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:18.296149 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:18.296492 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:18.296204 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:19.246987 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:19.246954 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 03 20:04:19.247185 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:19.247009 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 03 20:04:19.295878 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:19.295846 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 03 20:04:19.296034 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:19.295905 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 03 20:04:20.553985 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:20.553921 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:20.554569 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:20.554552 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:20.556723 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:20.556706 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" Nov 03 20:04:20.583050 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:20.583030 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:20.583321 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:20.583299 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:20.584023 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:20.584000 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" Nov 03 20:04:20.725417 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:20.725355 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podStartSLOduration=10.725342889 podStartE2EDuration="10.725342889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:04:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:04:12.229216517 +0000 UTC m=+800.010933184" watchObservedRunningTime="2026-11-03 20:04:20.725342889 +0000 UTC m=+808.507059554" Nov 03 20:04:26.247265 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.247229 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk"] Nov 03 20:04:26.252086 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.252069 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.305672 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.305632 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:04:26.353517 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.353480 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdkg9\" (UniqueName: \"kubernetes.io/projected/a46b744c-7240-4fae-a707-4d53a9f8fa05-kube-api-access-zdkg9\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.353517 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.353525 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.353738 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.353550 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.355062 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.355044 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:04:26.357762 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.357742 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk"] Nov 03 20:04:26.454547 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.454514 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdkg9\" (UniqueName: \"kubernetes.io/projected/a46b744c-7240-4fae-a707-4d53a9f8fa05-kube-api-access-zdkg9\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.454547 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.454550 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.454775 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.454573 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.455223 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.455194 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.457117 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.457090 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.515708 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.515634 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdkg9\" (UniqueName: \"kubernetes.io/projected/a46b744c-7240-4fae-a707-4d53a9f8fa05-kube-api-access-zdkg9\") pod \"maas-api-revoke-sub-6e268dd5-cdvbk\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.568400 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.568366 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:26.941742 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:26.941714 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk"] Nov 03 20:04:26.942878 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:04:26.942857 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46b744c_7240_4fae_a707_4d53a9f8fa05.slice/crio-e9e824ca34beb3bb6c0a9e5f3eda9e7b0744f3d19a7201e32811d0758613d071 WatchSource:0}: Error finding container e9e824ca34beb3bb6c0a9e5f3eda9e7b0744f3d19a7201e32811d0758613d071: Status 404 returned error can't find the container with id e9e824ca34beb3bb6c0a9e5f3eda9e7b0744f3d19a7201e32811d0758613d071 Nov 03 20:04:27.093517 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:27.093485 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" event={"ID":"a46b744c-7240-4fae-a707-4d53a9f8fa05","Type":"ContainerStarted","Data":"e9e824ca34beb3bb6c0a9e5f3eda9e7b0744f3d19a7201e32811d0758613d071"} Nov 03 20:04:31.120037 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:31.119950 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" event={"ID":"a46b744c-7240-4fae-a707-4d53a9f8fa05","Type":"ContainerStarted","Data":"3eb5d1e266dc9f3720fb51905adc73a369d5cfd619f29a931fc8c7518e104679"} Nov 03 20:04:31.236262 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:31.236210 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" podStartSLOduration=1.624609146 podStartE2EDuration="5.236195708s" totalImagesPullingTime="3.611586562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:04:31.23509315 +0000 UTC m=+819.016809817" watchObservedRunningTime="2026-11-03 20:04:31.236195708 +0000 UTC m=+819.017912373" Nov 03 20:04:32.127672 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:32.127644 5024 generic.go:356] "Generic (PLEG): container finished" podID="a46b744c-7240-4fae-a707-4d53a9f8fa05" containerID="3eb5d1e266dc9f3720fb51905adc73a369d5cfd619f29a931fc8c7518e104679" exitCode=0 Nov 03 20:04:32.128067 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:32.127683 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" event={"ID":"a46b744c-7240-4fae-a707-4d53a9f8fa05","Type":"ContainerDied","Data":"3eb5d1e266dc9f3720fb51905adc73a369d5cfd619f29a931fc8c7518e104679"} Nov 03 20:04:33.264535 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.264513 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:33.317568 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.317545 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-openshift-ca\") pod \"a46b744c-7240-4fae-a707-4d53a9f8fa05\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " Nov 03 20:04:33.317704 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.317640 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a46b744c-7240-4fae-a707-4d53a9f8fa05-kube-api-access-zdkg9\" (UniqueName: \"kubernetes.io/projected/a46b744c-7240-4fae-a707-4d53a9f8fa05-kube-api-access-zdkg9\") pod \"a46b744c-7240-4fae-a707-4d53a9f8fa05\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " Nov 03 20:04:33.317704 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.317671 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-xks-ca\") pod \"a46b744c-7240-4fae-a707-4d53a9f8fa05\" (UID: \"a46b744c-7240-4fae-a707-4d53a9f8fa05\") " Nov 03 20:04:33.317992 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.317968 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-openshift-ca" pod "a46b744c-7240-4fae-a707-4d53a9f8fa05" (UID: "a46b744c-7240-4fae-a707-4d53a9f8fa05"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:04:33.319843 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.319813 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a46b744c-7240-4fae-a707-4d53a9f8fa05-kube-api-access-zdkg9" pod "a46b744c-7240-4fae-a707-4d53a9f8fa05" (UID: "a46b744c-7240-4fae-a707-4d53a9f8fa05"). InnerVolumeSpecName "kube-api-access-zdkg9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:04:33.319977 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.319957 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-xks-ca" pod "a46b744c-7240-4fae-a707-4d53a9f8fa05" (UID: "a46b744c-7240-4fae-a707-4d53a9f8fa05"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:04:33.419119 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.419099 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:33.419119 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.419120 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdkg9\" (UniqueName: \"kubernetes.io/projected/a46b744c-7240-4fae-a707-4d53a9f8fa05-kube-api-access-zdkg9\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:33.419274 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:33.419130 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a46b744c-7240-4fae-a707-4d53a9f8fa05-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:34.139122 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:34.139098 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" Nov 03 20:04:34.139122 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:34.139109 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk" event={"ID":"a46b744c-7240-4fae-a707-4d53a9f8fa05","Type":"ContainerDied","Data":"e9e824ca34beb3bb6c0a9e5f3eda9e7b0744f3d19a7201e32811d0758613d071"} Nov 03 20:04:34.139332 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:34.139151 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9e824ca34beb3bb6c0a9e5f3eda9e7b0744f3d19a7201e32811d0758613d071" Nov 03 20:04:37.194453 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.194416 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6"] Nov 03 20:04:37.194858 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.194844 5024 cpu_manager.go:414] "containerMap: removing container" podUID="a46b744c-7240-4fae-a707-4d53a9f8fa05" containerName="revoke-keys" Nov 03 20:04:37.194902 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.194859 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a46b744c-7240-4fae-a707-4d53a9f8fa05" containerName="revoke-keys" Nov 03 20:04:37.194997 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.194988 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="a46b744c-7240-4fae-a707-4d53a9f8fa05" containerName="revoke-keys" Nov 03 20:04:37.198649 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.198630 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.253005 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.252614 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:04:37.256139 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.256111 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6"] Nov 03 20:04:37.302116 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.302092 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:04:37.356707 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.356671 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rls56\" (UniqueName: \"kubernetes.io/projected/0589ccd6-508b-4d52-92fc-fb2885665bc4-kube-api-access-rls56\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.356877 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.356718 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.356877 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.356736 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.457730 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.457643 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rls56\" (UniqueName: \"kubernetes.io/projected/0589ccd6-508b-4d52-92fc-fb2885665bc4-kube-api-access-rls56\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.457912 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.457768 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.457912 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.457795 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.458576 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.458546 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.460692 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.460669 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.518693 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.518660 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rls56\" (UniqueName: \"kubernetes.io/projected/0589ccd6-508b-4d52-92fc-fb2885665bc4-kube-api-access-rls56\") pod \"maas-api-revoke-sub-f957dce9-v8tp6\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:37.571919 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:04:37.571884 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:04:37.810730 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:37.810646 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:38.188657 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:38.188634 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6"] Nov 03 20:04:38.190096 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:04:38.190064 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0589ccd6_508b_4d52_92fc_fb2885665bc4.slice/crio-a410bcc711a89336f13b044ce0ef9192be161832d366eba439b0324807488220 WatchSource:0}: Error finding container a410bcc711a89336f13b044ce0ef9192be161832d366eba439b0324807488220: Status 404 returned error can't find the container with id a410bcc711a89336f13b044ce0ef9192be161832d366eba439b0324807488220 Nov 03 20:04:39.171967 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:39.171905 5024 generic.go:356] "Generic (PLEG): container finished" podID="0589ccd6-508b-4d52-92fc-fb2885665bc4" containerID="af530b2e945b040222f0dc667d5e0fd59f500a3438622a1dde77344ba80c2aa8" exitCode=0 Nov 03 20:04:39.172388 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:39.171981 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" event={"ID":"0589ccd6-508b-4d52-92fc-fb2885665bc4","Type":"ContainerDied","Data":"af530b2e945b040222f0dc667d5e0fd59f500a3438622a1dde77344ba80c2aa8"} Nov 03 20:04:39.172388 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:39.172090 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" event={"ID":"0589ccd6-508b-4d52-92fc-fb2885665bc4","Type":"ContainerStarted","Data":"a410bcc711a89336f13b044ce0ef9192be161832d366eba439b0324807488220"} Nov 03 20:04:40.315234 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.315212 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:40.487568 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.487499 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0589ccd6-508b-4d52-92fc-fb2885665bc4-kube-api-access-rls56\" (UniqueName: \"kubernetes.io/projected/0589ccd6-508b-4d52-92fc-fb2885665bc4-kube-api-access-rls56\") pod \"0589ccd6-508b-4d52-92fc-fb2885665bc4\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " Nov 03 20:04:40.487568 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.487532 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-xks-ca\") pod \"0589ccd6-508b-4d52-92fc-fb2885665bc4\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " Nov 03 20:04:40.487789 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.487638 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-openshift-ca\") pod \"0589ccd6-508b-4d52-92fc-fb2885665bc4\" (UID: \"0589ccd6-508b-4d52-92fc-fb2885665bc4\") " Nov 03 20:04:40.488021 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.487980 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-openshift-ca" pod "0589ccd6-508b-4d52-92fc-fb2885665bc4" (UID: "0589ccd6-508b-4d52-92fc-fb2885665bc4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:04:40.488136 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.488085 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:40.489821 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.489788 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-xks-ca" pod "0589ccd6-508b-4d52-92fc-fb2885665bc4" (UID: "0589ccd6-508b-4d52-92fc-fb2885665bc4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:04:40.489908 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.489845 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0589ccd6-508b-4d52-92fc-fb2885665bc4-kube-api-access-rls56" pod "0589ccd6-508b-4d52-92fc-fb2885665bc4" (UID: "0589ccd6-508b-4d52-92fc-fb2885665bc4"). InnerVolumeSpecName "kube-api-access-rls56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:04:40.588569 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.588529 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rls56\" (UniqueName: \"kubernetes.io/projected/0589ccd6-508b-4d52-92fc-fb2885665bc4-kube-api-access-rls56\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:40.588569 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:40.588563 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0589ccd6-508b-4d52-92fc-fb2885665bc4-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:41.184203 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:41.184171 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" event={"ID":"0589ccd6-508b-4d52-92fc-fb2885665bc4","Type":"ContainerDied","Data":"a410bcc711a89336f13b044ce0ef9192be161832d366eba439b0324807488220"} Nov 03 20:04:41.184347 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:41.184219 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a410bcc711a89336f13b044ce0ef9192be161832d366eba439b0324807488220" Nov 03 20:04:41.184347 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:41.184185 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6" Nov 03 20:04:46.119383 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:46.119353 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:04:48.021665 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.021634 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84"] Nov 03 20:04:48.022883 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.022853 5024 cpu_manager.go:414] "containerMap: removing container" podUID="0589ccd6-508b-4d52-92fc-fb2885665bc4" containerName="revoke-keys" Nov 03 20:04:48.022883 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.022884 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0589ccd6-508b-4d52-92fc-fb2885665bc4" containerName="revoke-keys" Nov 03 20:04:48.023120 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.023056 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="0589ccd6-508b-4d52-92fc-fb2885665bc4" containerName="revoke-keys" Nov 03 20:04:48.029637 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.029604 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.087913 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.087883 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84"] Nov 03 20:04:48.128277 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.128251 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:04:48.128521 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.128256 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:04:48.151063 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.151031 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wmbj\" (UniqueName: \"kubernetes.io/projected/0443e325-d932-4a37-9edd-affd32ed332c-kube-api-access-8wmbj\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.151232 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.151131 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.151232 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.151172 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.252662 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.252627 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.253033 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.253011 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wmbj\" (UniqueName: \"kubernetes.io/projected/0443e325-d932-4a37-9edd-affd32ed332c-kube-api-access-8wmbj\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.253235 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.253216 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.254173 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.254147 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.255862 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.255834 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.314843 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.314785 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wmbj\" (UniqueName: \"kubernetes.io/projected/0443e325-d932-4a37-9edd-affd32ed332c-kube-api-access-8wmbj\") pod \"maas-api-revoke-sub-8e501c84-jsd84\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.349707 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.349676 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:48.751352 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:48.751310 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84"] Nov 03 20:04:49.325952 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:49.316882 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" event={"ID":"0443e325-d932-4a37-9edd-affd32ed332c","Type":"ContainerStarted","Data":"f86c9ffeafb2e8375671e90499341529e01c2d60aac6bc58d625ed167ae492c3"} Nov 03 20:04:49.325952 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:49.316972 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" event={"ID":"0443e325-d932-4a37-9edd-affd32ed332c","Type":"ContainerStarted","Data":"44504258295fdc71bbbe486189ce260592d18c670b8ad87e25ab10ef5e11ddcc"} Nov 03 20:04:50.387142 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:50.386530 5024 generic.go:356] "Generic (PLEG): container finished" podID="0443e325-d932-4a37-9edd-affd32ed332c" containerID="f86c9ffeafb2e8375671e90499341529e01c2d60aac6bc58d625ed167ae492c3" exitCode=0 Nov 03 20:04:50.387142 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:50.386638 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" event={"ID":"0443e325-d932-4a37-9edd-affd32ed332c","Type":"ContainerDied","Data":"f86c9ffeafb2e8375671e90499341529e01c2d60aac6bc58d625ed167ae492c3"} Nov 03 20:04:50.719029 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:50.718952 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:04:50.719407 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:50.719288 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:04:51.627717 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.627665 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:04:51.628360 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.628321 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:04:51.685134 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.685084 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:51.697965 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.697943 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0443e325-d932-4a37-9edd-affd32ed332c-kube-api-access-8wmbj\" (UniqueName: \"kubernetes.io/projected/0443e325-d932-4a37-9edd-affd32ed332c-kube-api-access-8wmbj\") pod \"0443e325-d932-4a37-9edd-affd32ed332c\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " Nov 03 20:04:51.698063 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.698038 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-openshift-ca\") pod \"0443e325-d932-4a37-9edd-affd32ed332c\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " Nov 03 20:04:51.698116 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.698096 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-xks-ca\") pod \"0443e325-d932-4a37-9edd-affd32ed332c\" (UID: \"0443e325-d932-4a37-9edd-affd32ed332c\") " Nov 03 20:04:51.698362 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.698341 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-openshift-ca" pod "0443e325-d932-4a37-9edd-affd32ed332c" (UID: "0443e325-d932-4a37-9edd-affd32ed332c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:04:51.700177 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.700153 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-xks-ca" pod "0443e325-d932-4a37-9edd-affd32ed332c" (UID: "0443e325-d932-4a37-9edd-affd32ed332c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:04:51.700259 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.700182 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0443e325-d932-4a37-9edd-affd32ed332c-kube-api-access-8wmbj" pod "0443e325-d932-4a37-9edd-affd32ed332c" (UID: "0443e325-d932-4a37-9edd-affd32ed332c"). InnerVolumeSpecName "kube-api-access-8wmbj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:04:51.799575 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.799551 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:51.799693 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.799580 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wmbj\" (UniqueName: \"kubernetes.io/projected/0443e325-d932-4a37-9edd-affd32ed332c-kube-api-access-8wmbj\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:51.799693 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:51.799592 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0443e325-d932-4a37-9edd-affd32ed332c-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:04:52.408209 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:52.408183 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" Nov 03 20:04:52.408349 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:52.408215 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84" event={"ID":"0443e325-d932-4a37-9edd-affd32ed332c","Type":"ContainerDied","Data":"44504258295fdc71bbbe486189ce260592d18c670b8ad87e25ab10ef5e11ddcc"} Nov 03 20:04:52.408349 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:52.408264 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44504258295fdc71bbbe486189ce260592d18c670b8ad87e25ab10ef5e11ddcc" Nov 03 20:04:58.740437 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.740371 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7"] Nov 03 20:04:58.740910 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.740895 5024 cpu_manager.go:414] "containerMap: removing container" podUID="0443e325-d932-4a37-9edd-affd32ed332c" containerName="revoke-keys" Nov 03 20:04:58.740988 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.740912 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0443e325-d932-4a37-9edd-affd32ed332c" containerName="revoke-keys" Nov 03 20:04:58.741030 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.741004 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="0443e325-d932-4a37-9edd-affd32ed332c" containerName="revoke-keys" Nov 03 20:04:58.746409 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.746385 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.799895 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.799812 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:04:58.849384 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.849362 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:04:58.852219 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.852201 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7"] Nov 03 20:04:58.861396 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.861364 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.861576 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.861405 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.861576 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.861549 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rclsf\" (UniqueName: \"kubernetes.io/projected/2ff3c22e-1c3f-4951-ace1-c8fff359160d-kube-api-access-rclsf\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.962131 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.962094 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rclsf\" (UniqueName: \"kubernetes.io/projected/2ff3c22e-1c3f-4951-ace1-c8fff359160d-kube-api-access-rclsf\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.962310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.962190 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.962310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.962214 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.962959 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.962909 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:58.964657 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:58.964631 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:59.025593 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:59.025525 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rclsf\" (UniqueName: \"kubernetes.io/projected/2ff3c22e-1c3f-4951-ace1-c8fff359160d-kube-api-access-rclsf\") pod \"maas-api-revoke-sub-70d0730a-872w7\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:59.079652 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:59.079620 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:04:59.451856 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:04:59.451832 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7"] Nov 03 20:04:59.453069 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:04:59.453045 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff3c22e_1c3f_4951_ace1_c8fff359160d.slice/crio-7b015367e365e336f1455cbe5b6615b2d58dbcc4939abe895647d5f3173206bc WatchSource:0}: Error finding container 7b015367e365e336f1455cbe5b6615b2d58dbcc4939abe895647d5f3173206bc: Status 404 returned error can't find the container with id 7b015367e365e336f1455cbe5b6615b2d58dbcc4939abe895647d5f3173206bc Nov 03 20:05:00.457726 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:00.457689 5024 generic.go:356] "Generic (PLEG): container finished" podID="2ff3c22e-1c3f-4951-ace1-c8fff359160d" containerID="095d1e710355a49b8cd18f4ff6a4751418e2515d3012da721c83c1a22b57a8f2" exitCode=0 Nov 03 20:05:00.458202 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:00.457772 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" event={"ID":"2ff3c22e-1c3f-4951-ace1-c8fff359160d","Type":"ContainerDied","Data":"095d1e710355a49b8cd18f4ff6a4751418e2515d3012da721c83c1a22b57a8f2"} Nov 03 20:05:00.458202 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:00.457826 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" event={"ID":"2ff3c22e-1c3f-4951-ace1-c8fff359160d","Type":"ContainerStarted","Data":"7b015367e365e336f1455cbe5b6615b2d58dbcc4939abe895647d5f3173206bc"} Nov 03 20:05:01.592702 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.592678 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:05:01.686120 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.686090 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-xks-ca\") pod \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " Nov 03 20:05:01.686310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.686185 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ff3c22e-1c3f-4951-ace1-c8fff359160d-kube-api-access-rclsf\" (UniqueName: \"kubernetes.io/projected/2ff3c22e-1c3f-4951-ace1-c8fff359160d-kube-api-access-rclsf\") pod \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " Nov 03 20:05:01.686310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.686265 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-openshift-ca\") pod \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\" (UID: \"2ff3c22e-1c3f-4951-ace1-c8fff359160d\") " Nov 03 20:05:01.686628 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.686604 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-openshift-ca" pod "2ff3c22e-1c3f-4951-ace1-c8fff359160d" (UID: "2ff3c22e-1c3f-4951-ace1-c8fff359160d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:05:01.688250 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.688228 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-xks-ca" pod "2ff3c22e-1c3f-4951-ace1-c8fff359160d" (UID: "2ff3c22e-1c3f-4951-ace1-c8fff359160d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:05:01.688336 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.688319 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff3c22e-1c3f-4951-ace1-c8fff359160d-kube-api-access-rclsf" pod "2ff3c22e-1c3f-4951-ace1-c8fff359160d" (UID: "2ff3c22e-1c3f-4951-ace1-c8fff359160d"). InnerVolumeSpecName "kube-api-access-rclsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:05:01.788329 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.788229 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:01.788329 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.788266 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2ff3c22e-1c3f-4951-ace1-c8fff359160d-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:01.788329 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:01.788282 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rclsf\" (UniqueName: \"kubernetes.io/projected/2ff3c22e-1c3f-4951-ace1-c8fff359160d-kube-api-access-rclsf\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:02.473367 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:02.473328 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" event={"ID":"2ff3c22e-1c3f-4951-ace1-c8fff359160d","Type":"ContainerDied","Data":"7b015367e365e336f1455cbe5b6615b2d58dbcc4939abe895647d5f3173206bc"} Nov 03 20:05:02.473570 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:02.473392 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b015367e365e336f1455cbe5b6615b2d58dbcc4939abe895647d5f3173206bc" Nov 03 20:05:02.473570 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:02.473456 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7" Nov 03 20:05:07.571310 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:05:07.571271 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:05:09.469297 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.469257 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8"] Nov 03 20:05:09.469764 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.469660 5024 cpu_manager.go:414] "containerMap: removing container" podUID="2ff3c22e-1c3f-4951-ace1-c8fff359160d" containerName="revoke-keys" Nov 03 20:05:09.469764 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.469670 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ff3c22e-1c3f-4951-ace1-c8fff359160d" containerName="revoke-keys" Nov 03 20:05:09.469764 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.469759 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ff3c22e-1c3f-4951-ace1-c8fff359160d" containerName="revoke-keys" Nov 03 20:05:09.472831 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.472810 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.527155 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.527130 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:05:09.576644 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.576615 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:05:09.579422 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.579400 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8"] Nov 03 20:05:09.639868 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.639839 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.640031 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.639876 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.640074 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.640044 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9czqk\" (UniqueName: \"kubernetes.io/projected/fa511e40-b9b6-4b7d-b341-5c813b009620-kube-api-access-9czqk\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.740802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.740746 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.740905 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.740808 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9czqk\" (UniqueName: \"kubernetes.io/projected/fa511e40-b9b6-4b7d-b341-5c813b009620-kube-api-access-9czqk\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.740905 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.740864 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.741466 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.741450 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.743127 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.743110 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:09.801750 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:09.801729 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9czqk\" (UniqueName: \"kubernetes.io/projected/fa511e40-b9b6-4b7d-b341-5c813b009620-kube-api-access-9czqk\") pod \"maas-api-revoke-sub-4ed8392b-vwnq8\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:10.085595 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:10.085517 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:10.459385 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:10.459360 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8"] Nov 03 20:05:10.461002 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:05:10.460982 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa511e40_b9b6_4b7d_b341_5c813b009620.slice/crio-f146b3fc53573b17216a9ec7be57c8019eed541db36f621590fdd1fd271cf42a WatchSource:0}: Error finding container f146b3fc53573b17216a9ec7be57c8019eed541db36f621590fdd1fd271cf42a: Status 404 returned error can't find the container with id f146b3fc53573b17216a9ec7be57c8019eed541db36f621590fdd1fd271cf42a Nov 03 20:05:10.569300 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:10.569251 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" event={"ID":"fa511e40-b9b6-4b7d-b341-5c813b009620","Type":"ContainerStarted","Data":"f146b3fc53573b17216a9ec7be57c8019eed541db36f621590fdd1fd271cf42a"} Nov 03 20:05:11.576801 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:11.576716 5024 generic.go:356] "Generic (PLEG): container finished" podID="fa511e40-b9b6-4b7d-b341-5c813b009620" containerID="3dbe6282a3c8cbd070b0ccea940ab290dcdc9d469672f7a42c90067ae03e17aa" exitCode=0 Nov 03 20:05:11.576801 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:11.576790 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" event={"ID":"fa511e40-b9b6-4b7d-b341-5c813b009620","Type":"ContainerDied","Data":"3dbe6282a3c8cbd070b0ccea940ab290dcdc9d469672f7a42c90067ae03e17aa"} Nov 03 20:05:12.780619 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:12.780579 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:12.973647 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:12.973611 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-xks-ca\") pod \"fa511e40-b9b6-4b7d-b341-5c813b009620\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " Nov 03 20:05:12.973833 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:12.973716 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-openshift-ca\") pod \"fa511e40-b9b6-4b7d-b341-5c813b009620\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " Nov 03 20:05:12.973833 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:12.973782 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa511e40-b9b6-4b7d-b341-5c813b009620-kube-api-access-9czqk\" (UniqueName: \"kubernetes.io/projected/fa511e40-b9b6-4b7d-b341-5c813b009620-kube-api-access-9czqk\") pod \"fa511e40-b9b6-4b7d-b341-5c813b009620\" (UID: \"fa511e40-b9b6-4b7d-b341-5c813b009620\") " Nov 03 20:05:12.974212 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:12.974184 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-openshift-ca" pod "fa511e40-b9b6-4b7d-b341-5c813b009620" (UID: "fa511e40-b9b6-4b7d-b341-5c813b009620"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:05:12.977990 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:12.976604 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa511e40-b9b6-4b7d-b341-5c813b009620-kube-api-access-9czqk" pod "fa511e40-b9b6-4b7d-b341-5c813b009620" (UID: "fa511e40-b9b6-4b7d-b341-5c813b009620"). InnerVolumeSpecName "kube-api-access-9czqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:05:12.977990 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:12.976869 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-xks-ca" pod "fa511e40-b9b6-4b7d-b341-5c813b009620" (UID: "fa511e40-b9b6-4b7d-b341-5c813b009620"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:05:13.075597 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:13.075561 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:13.075597 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:13.075598 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/fa511e40-b9b6-4b7d-b341-5c813b009620-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:13.075848 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:13.075614 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9czqk\" (UniqueName: \"kubernetes.io/projected/fa511e40-b9b6-4b7d-b341-5c813b009620-kube-api-access-9czqk\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:13.624970 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:13.623958 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" event={"ID":"fa511e40-b9b6-4b7d-b341-5c813b009620","Type":"ContainerDied","Data":"f146b3fc53573b17216a9ec7be57c8019eed541db36f621590fdd1fd271cf42a"} Nov 03 20:05:13.624970 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:13.624019 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f146b3fc53573b17216a9ec7be57c8019eed541db36f621590fdd1fd271cf42a" Nov 03 20:05:13.624970 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:13.624092 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8" Nov 03 20:05:25.922381 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:25.922307 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:05:37.570730 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:05:37.570690 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:05:40.437250 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:40.437217 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx"] Nov 03 20:05:40.445277 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:40.445248 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:05:46.568721 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:46.568684 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:05:52.605480 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:52.605449 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 20:05:52.606826 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:52.606803 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 20:05:52.609299 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:52.609281 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 20:05:52.610697 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:52.610679 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 20:05:55.457230 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.457182 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" podUID="aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" containerName="main" containerID="cri-o://e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5" gracePeriod=45 Nov 03 20:05:55.722024 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.721969 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:05:55.829053 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829021 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-kube-api-access-4m7ds\" (UniqueName: \"kubernetes.io/projected/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-kube-api-access-4m7ds\") pod \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " Nov 03 20:05:55.829234 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829069 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tmp-dir\") pod \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " Nov 03 20:05:55.829234 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829125 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tls-certs\" (UniqueName: \"kubernetes.io/secret/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tls-certs\") pod \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " Nov 03 20:05:55.829234 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829170 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-model-cache\") pod \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " Nov 03 20:05:55.829234 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829215 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-home\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-home\") pod \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " Nov 03 20:05:55.829463 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829260 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-dshm\") pod \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\" (UID: \"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f\") " Nov 03 20:05:55.829463 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829391 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tmp-dir" pod "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" (UID: "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:55.829574 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829477 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-model-cache" pod "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" (UID: "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:55.829574 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829508 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-home" pod "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" (UID: "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:55.829574 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829570 5024 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tmp-dir\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:55.829722 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829584 5024 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-model-cache\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:55.829722 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.829594 5024 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-home\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:55.831412 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.831384 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-dshm" pod "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" (UID: "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:05:55.831536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.831436 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tls-certs" pod "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" (UID: "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:05:55.831593 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.831537 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-kube-api-access-4m7ds" pod "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" (UID: "aa43baa3-7a61-44b9-9abd-061f3fbf6e3f"). InnerVolumeSpecName "kube-api-access-4m7ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:05:55.930859 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.930825 5024 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-dshm\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:55.930859 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.930865 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m7ds\" (UniqueName: \"kubernetes.io/projected/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-kube-api-access-4m7ds\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:55.931087 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:55.930880 5024 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f-tls-certs\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:05:56.006250 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.006161 5024 generic.go:356] "Generic (PLEG): container finished" podID="aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" containerID="e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5" exitCode=0 Nov 03 20:05:56.006250 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.006209 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" Nov 03 20:05:56.006250 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.006240 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" event={"ID":"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f","Type":"ContainerDied","Data":"e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5"} Nov 03 20:05:56.006487 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.006285 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx" event={"ID":"aa43baa3-7a61-44b9-9abd-061f3fbf6e3f","Type":"ContainerDied","Data":"e02cd1d4537ee5770df3411ec8afedf474a7d10a9624cb2f2724094ab7f89318"} Nov 03 20:05:56.006487 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.006306 5024 scope.go:122] "RemoveContainer" containerID="e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5" Nov 03 20:05:56.016481 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.016463 5024 scope.go:122] "RemoveContainer" containerID="e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5" Nov 03 20:05:56.016762 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:05:56.016742 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5\": container with ID starting with e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5 not found: ID does not exist" containerID="e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5" Nov 03 20:05:56.016824 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.016776 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5"} err="failed to get container status \"e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5\": rpc error: code = NotFound desc = could not find container \"e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5\": container with ID starting with e8c35d6ed94a660175be139ac5b1dff0c922a6ab29f3ce4c3a8840171368c5d5 not found: ID does not exist" Nov 03 20:05:56.170879 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.170846 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx"] Nov 03 20:05:56.175392 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.175369 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/grid-inv-b695bb2e-unmatched-kserve-cd9dc9847-bnjhx"] Nov 03 20:05:56.334474 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:56.334401 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" path="/var/lib/kubelet/pods/aa43baa3-7a61-44b9-9abd-061f3fbf6e3f/volumes" Nov 03 20:05:59.704825 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:05:59.704790 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:03.389982 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:03.389952 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:06.608952 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:06.607127 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:06:06.608952 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:06.607209 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:06:07.725269 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:07.725229 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:06:13.199101 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:13.199058 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:06:13.199946 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:13.199881 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podUID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:06:32.722778 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.722705 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9041-2c82f4"] Nov 03 20:06:32.723227 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.723156 5024 cpu_manager.go:414] "containerMap: removing container" podUID="fa511e40-b9b6-4b7d-b341-5c813b009620" containerName="revoke-keys" Nov 03 20:06:32.723227 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.723169 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa511e40-b9b6-4b7d-b341-5c813b009620" containerName="revoke-keys" Nov 03 20:06:32.723227 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.723204 5024 cpu_manager.go:414] "containerMap: removing container" podUID="aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" containerName="main" Nov 03 20:06:32.723227 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.723211 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" containerName="main" Nov 03 20:06:32.723357 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.723287 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="aa43baa3-7a61-44b9-9abd-061f3fbf6e3f" containerName="main" Nov 03 20:06:32.723357 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.723298 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa511e40-b9b6-4b7d-b341-5c813b009620" containerName="revoke-keys" Nov 03 20:06:32.726789 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.726774 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:32.780529 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.780497 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-2c82f4"] Nov 03 20:06:32.826881 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.826853 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gfpm9\"" Nov 03 20:06:32.832226 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.832204 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-527b5\" (UniqueName: \"kubernetes.io/projected/f74c575b-79be-49bc-8afb-aab18504e950-kube-api-access-527b5\") pod \"test-curl-9041-2c82f4\" (UID: \"f74c575b-79be-49bc-8afb-aab18504e950\") " pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:32.933250 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.933212 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-527b5\" (UniqueName: \"kubernetes.io/projected/f74c575b-79be-49bc-8afb-aab18504e950-kube-api-access-527b5\") pod \"test-curl-9041-2c82f4\" (UID: \"f74c575b-79be-49bc-8afb-aab18504e950\") " pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:32.994809 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:32.994733 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-527b5\" (UniqueName: \"kubernetes.io/projected/f74c575b-79be-49bc-8afb-aab18504e950-kube-api-access-527b5\") pod \"test-curl-9041-2c82f4\" (UID: \"f74c575b-79be-49bc-8afb-aab18504e950\") " pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:33.054740 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:33.054703 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:33.428127 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:33.428105 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-2c82f4"] Nov 03 20:06:33.429834 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:06:33.429805 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf74c575b_79be_49bc_8afb_aab18504e950.slice/crio-b0cabc2e1acb85ab0a138d1f6de931fae08cbe42879f86c5a072b97a2424185f WatchSource:0}: Error finding container b0cabc2e1acb85ab0a138d1f6de931fae08cbe42879f86c5a072b97a2424185f: Status 404 returned error can't find the container with id b0cabc2e1acb85ab0a138d1f6de931fae08cbe42879f86c5a072b97a2424185f Nov 03 20:06:34.387174 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:34.387134 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-2c82f4" event={"ID":"f74c575b-79be-49bc-8afb-aab18504e950","Type":"ContainerStarted","Data":"b0cabc2e1acb85ab0a138d1f6de931fae08cbe42879f86c5a072b97a2424185f"} Nov 03 20:06:36.402323 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:36.402286 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-2c82f4" event={"ID":"f74c575b-79be-49bc-8afb-aab18504e950","Type":"ContainerStarted","Data":"2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41"} Nov 03 20:06:36.516077 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:36.516018 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9041-2c82f4" podStartSLOduration=2.161981269 podStartE2EDuration="4.516004189s" totalImagesPullingTime="2.35402292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:36.515462612 +0000 UTC m=+944.297179277" watchObservedRunningTime="2026-11-03 20:06:36.516004189 +0000 UTC m=+944.297720849" Nov 03 20:06:37.570061 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:37.570024 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:06:38.100238 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.100207 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9041-2c82f4"] Nov 03 20:06:38.103431 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.103399 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9041-2c82f4"] Nov 03 20:06:38.413454 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.413419 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9041-2c82f4" podUID="f74c575b-79be-49bc-8afb-aab18504e950" containerName="test-curl-9041-2c82f4" containerID="cri-o://2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41" gracePeriod=2 Nov 03 20:06:38.703949 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.703857 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9041-a678b6"] Nov 03 20:06:38.704322 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.704308 5024 cpu_manager.go:414] "containerMap: removing container" podUID="f74c575b-79be-49bc-8afb-aab18504e950" containerName="test-curl-9041-2c82f4" Nov 03 20:06:38.704363 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.704323 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f74c575b-79be-49bc-8afb-aab18504e950" containerName="test-curl-9041-2c82f4" Nov 03 20:06:38.704414 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.704404 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="f74c575b-79be-49bc-8afb-aab18504e950" containerName="test-curl-9041-2c82f4" Nov 03 20:06:38.707661 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.707646 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:38.764118 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.764089 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-a678b6"] Nov 03 20:06:38.790338 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.790306 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qtms\" (UniqueName: \"kubernetes.io/projected/6af372d4-a8ae-4e22-9514-2869ba241b6d-kube-api-access-8qtms\") pod \"test-curl-9041-a678b6\" (UID: \"6af372d4-a8ae-4e22-9514-2869ba241b6d\") " pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:38.891139 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.891108 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qtms\" (UniqueName: \"kubernetes.io/projected/6af372d4-a8ae-4e22-9514-2869ba241b6d-kube-api-access-8qtms\") pod \"test-curl-9041-a678b6\" (UID: \"6af372d4-a8ae-4e22-9514-2869ba241b6d\") " pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:38.952384 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:38.952344 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qtms\" (UniqueName: \"kubernetes.io/projected/6af372d4-a8ae-4e22-9514-2869ba241b6d-kube-api-access-8qtms\") pod \"test-curl-9041-a678b6\" (UID: \"6af372d4-a8ae-4e22-9514-2869ba241b6d\") " pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:39.019042 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:39.018957 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:39.389575 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:39.389552 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-a678b6"] Nov 03 20:06:39.391088 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:06:39.391057 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6af372d4_a8ae_4e22_9514_2869ba241b6d.slice/crio-59655a703d12d8cc8ce9eb70855e2010baa8c4e58dabf0e803d6d56d6ef75f50 WatchSource:0}: Error finding container 59655a703d12d8cc8ce9eb70855e2010baa8c4e58dabf0e803d6d56d6ef75f50: Status 404 returned error can't find the container with id 59655a703d12d8cc8ce9eb70855e2010baa8c4e58dabf0e803d6d56d6ef75f50 Nov 03 20:06:39.421096 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:39.421068 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-a678b6" event={"ID":"6af372d4-a8ae-4e22-9514-2869ba241b6d","Type":"ContainerStarted","Data":"59655a703d12d8cc8ce9eb70855e2010baa8c4e58dabf0e803d6d56d6ef75f50"} Nov 03 20:06:40.429392 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:40.429261 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-a678b6" event={"ID":"6af372d4-a8ae-4e22-9514-2869ba241b6d","Type":"ContainerStarted","Data":"7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68"} Nov 03 20:06:40.542380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:40.542327 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9041-a678b6" podStartSLOduration=2.542313486 podStartE2EDuration="2.542313486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:40.541883406 +0000 UTC m=+948.323600077" watchObservedRunningTime="2026-11-03 20:06:40.542313486 +0000 UTC m=+948.324030151" Nov 03 20:06:40.658118 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:40.658093 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:40.811865 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:40.811771 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f74c575b-79be-49bc-8afb-aab18504e950-kube-api-access-527b5\" (UniqueName: \"kubernetes.io/projected/f74c575b-79be-49bc-8afb-aab18504e950-kube-api-access-527b5\") pod \"f74c575b-79be-49bc-8afb-aab18504e950\" (UID: \"f74c575b-79be-49bc-8afb-aab18504e950\") " Nov 03 20:06:40.814210 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:40.814178 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f74c575b-79be-49bc-8afb-aab18504e950-kube-api-access-527b5" pod "f74c575b-79be-49bc-8afb-aab18504e950" (UID: "f74c575b-79be-49bc-8afb-aab18504e950"). InnerVolumeSpecName "kube-api-access-527b5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:06:40.913378 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:40.913331 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-527b5\" (UniqueName: \"kubernetes.io/projected/f74c575b-79be-49bc-8afb-aab18504e950-kube-api-access-527b5\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:06:41.436830 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:41.436797 5024 generic.go:356] "Generic (PLEG): container finished" podID="f74c575b-79be-49bc-8afb-aab18504e950" containerID="2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41" exitCode=137 Nov 03 20:06:41.436830 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:41.436847 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:41.437388 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:41.436896 5024 scope.go:122] "RemoveContainer" containerID="2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41" Nov 03 20:06:41.447277 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:41.447259 5024 scope.go:122] "RemoveContainer" containerID="2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41" Nov 03 20:06:41.447620 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:41.447601 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41\": container with ID starting with 2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41 not found: ID does not exist" containerID="2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41" Nov 03 20:06:41.447674 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:41.447632 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41"} err="failed to get container status \"2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41\": rpc error: code = NotFound desc = could not find container \"2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41\": container with ID starting with 2ac8ef4c37eff3c2fbd5b48564b3230bbcc9692abf6bf57ed2f121fd31928c41 not found: ID does not exist" Nov 03 20:06:41.496140 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:41.496099 5024 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-2c82f4\" is forbidden: User \"system:node:ip-10-0-131-64.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-64.us-west-1.compute.internal' and this object" podUID="f74c575b-79be-49bc-8afb-aab18504e950" pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:42.028865 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.028822 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9041-a678b6"] Nov 03 20:06:42.032514 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.032483 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9041-a678b6"] Nov 03 20:06:42.336450 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.336374 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f74c575b-79be-49bc-8afb-aab18504e950" path="/var/lib/kubelet/pods/f74c575b-79be-49bc-8afb-aab18504e950/volumes" Nov 03 20:06:42.384399 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:42.384366 5024 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-2c82f4\" is forbidden: User \"system:node:ip-10-0-131-64.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-64.us-west-1.compute.internal' and this object" podUID="f74c575b-79be-49bc-8afb-aab18504e950" pod="opendatahub/test-curl-9041-2c82f4" Nov 03 20:06:42.425916 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.425884 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-9041-19b575"] Nov 03 20:06:42.426340 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.426326 5024 cpu_manager.go:414] "containerMap: removing container" podUID="6af372d4-a8ae-4e22-9514-2869ba241b6d" containerName="test-curl-9041-a678b6" Nov 03 20:06:42.426385 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.426341 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6af372d4-a8ae-4e22-9514-2869ba241b6d" containerName="test-curl-9041-a678b6" Nov 03 20:06:42.426421 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.426409 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="6af372d4-a8ae-4e22-9514-2869ba241b6d" containerName="test-curl-9041-a678b6" Nov 03 20:06:42.430854 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.430832 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:42.443304 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.443272 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9041-a678b6" podUID="6af372d4-a8ae-4e22-9514-2869ba241b6d" containerName="test-curl-9041-a678b6" containerID="cri-o://7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68" gracePeriod=2 Nov 03 20:06:42.485342 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.485310 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-19b575"] Nov 03 20:06:42.528418 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.528379 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/766fc244-367f-49c6-97bf-70aca1cf984a-kube-api-access-nznxq\") pod \"test-curl-9041-19b575\" (UID: \"766fc244-367f-49c6-97bf-70aca1cf984a\") " pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:42.629181 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.629084 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/766fc244-367f-49c6-97bf-70aca1cf984a-kube-api-access-nznxq\") pod \"test-curl-9041-19b575\" (UID: \"766fc244-367f-49c6-97bf-70aca1cf984a\") " pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:42.690207 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.690176 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/766fc244-367f-49c6-97bf-70aca1cf984a-kube-api-access-nznxq\") pod \"test-curl-9041-19b575\" (UID: \"766fc244-367f-49c6-97bf-70aca1cf984a\") " pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:42.742252 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:42.742210 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:43.117843 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:43.117813 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-9041-19b575"] Nov 03 20:06:43.119063 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:06:43.119037 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod766fc244_367f_49c6_97bf_70aca1cf984a.slice/crio-365f6a92a66f3f0169232fdf8f42b10168b1349de06a165722107a33091c8a2f WatchSource:0}: Error finding container 365f6a92a66f3f0169232fdf8f42b10168b1349de06a165722107a33091c8a2f: Status 404 returned error can't find the container with id 365f6a92a66f3f0169232fdf8f42b10168b1349de06a165722107a33091c8a2f Nov 03 20:06:43.451120 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:43.451080 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-19b575" event={"ID":"766fc244-367f-49c6-97bf-70aca1cf984a","Type":"ContainerStarted","Data":"961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d"} Nov 03 20:06:43.451568 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:43.451132 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-9041-19b575" event={"ID":"766fc244-367f-49c6-97bf-70aca1cf984a","Type":"ContainerStarted","Data":"365f6a92a66f3f0169232fdf8f42b10168b1349de06a165722107a33091c8a2f"} Nov 03 20:06:43.564471 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:43.564395 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/test-curl-9041-19b575" podStartSLOduration=1.564377117 podStartE2EDuration="1.564377117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:43.563844919 +0000 UTC m=+951.345561585" watchObservedRunningTime="2026-11-03 20:06:43.564377117 +0000 UTC m=+951.346093785" Nov 03 20:06:44.674623 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:44.674588 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:44.751176 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:44.751089 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6af372d4-a8ae-4e22-9514-2869ba241b6d-kube-api-access-8qtms\" (UniqueName: \"kubernetes.io/projected/6af372d4-a8ae-4e22-9514-2869ba241b6d-kube-api-access-8qtms\") pod \"6af372d4-a8ae-4e22-9514-2869ba241b6d\" (UID: \"6af372d4-a8ae-4e22-9514-2869ba241b6d\") " Nov 03 20:06:44.753160 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:44.753123 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af372d4-a8ae-4e22-9514-2869ba241b6d-kube-api-access-8qtms" pod "6af372d4-a8ae-4e22-9514-2869ba241b6d" (UID: "6af372d4-a8ae-4e22-9514-2869ba241b6d"). InnerVolumeSpecName "kube-api-access-8qtms". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:06:44.852696 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:44.852658 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qtms\" (UniqueName: \"kubernetes.io/projected/6af372d4-a8ae-4e22-9514-2869ba241b6d-kube-api-access-8qtms\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:06:45.021800 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.021709 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-9041-19b575"] Nov 03 20:06:45.026716 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.026687 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-9041-19b575"] Nov 03 20:06:45.463699 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.463663 5024 generic.go:356] "Generic (PLEG): container finished" podID="6af372d4-a8ae-4e22-9514-2869ba241b6d" containerID="7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68" exitCode=137 Nov 03 20:06:45.463882 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.463718 5024 scope.go:122] "RemoveContainer" containerID="7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68" Nov 03 20:06:45.463882 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.463715 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:45.464102 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.464066 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/test-curl-9041-19b575" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" containerName="test-curl-9041-19b575" containerID="cri-o://961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d" gracePeriod=2 Nov 03 20:06:45.473946 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.473903 5024 scope.go:122] "RemoveContainer" containerID="7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68" Nov 03 20:06:45.474242 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:45.474224 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68\": container with ID starting with 7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68 not found: ID does not exist" containerID="7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68" Nov 03 20:06:45.474301 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.474251 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68"} err="failed to get container status \"7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68\": rpc error: code = NotFound desc = could not find container \"7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68\": container with ID starting with 7e8f985b501c98ec03e58fffe0cdf999295864c762320db262f3234903d2fd68 not found: ID does not exist" Nov 03 20:06:45.515128 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:45.515089 5024 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-19b575\" is forbidden: User \"system:node:ip-10-0-131-64.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-64.us-west-1.compute.internal' and this object" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:45.565864 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:45.565821 5024 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-19b575\" is forbidden: User \"system:node:ip-10-0-131-64.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-64.us-west-1.compute.internal' and this object" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:45.616644 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:45.616605 5024 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-a678b6\" is forbidden: User \"system:node:ip-10-0-131-64.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-64.us-west-1.compute.internal' and this object" podUID="6af372d4-a8ae-4e22-9514-2869ba241b6d" pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:45.637270 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:45.637240 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:46.090694 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.090664 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8"] Nov 03 20:06:46.091118 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.091085 5024 cpu_manager.go:414] "containerMap: removing container" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" containerName="test-curl-9041-19b575" Nov 03 20:06:46.091118 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.091096 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" containerName="test-curl-9041-19b575" Nov 03 20:06:46.091195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.091189 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" containerName="test-curl-9041-19b575" Nov 03 20:06:46.095557 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.095539 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.148037 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:46.147866 5024 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-a678b6\" is forbidden: User \"system:node:ip-10-0-131-64.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-64.us-west-1.compute.internal' and this object" podUID="6af372d4-a8ae-4e22-9514-2869ba241b6d" pod="opendatahub/test-curl-9041-a678b6" Nov 03 20:06:46.148037 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.147981 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-main-e56f6e-openshift-default-dockercfg-4jq9q\"" Nov 03 20:06:46.164952 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.164894 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-envoy\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165036 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-podinfo\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165189 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165164 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-data\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165225 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165210 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istiod-ca-cert\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165300 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165286 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-token\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165365 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-socket\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165422 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165406 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-credential-socket\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165477 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165461 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb4n5\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-kube-api-access-wb4n5\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.165511 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.165493 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-certs\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.187072 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.187044 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8"] Nov 03 20:06:46.210096 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.210071 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:46.266677 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266640 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-envoy\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.266853 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266700 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-podinfo\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.266853 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266780 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-data\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.266853 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266807 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istiod-ca-cert\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.266853 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266840 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-token\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267132 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266912 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-socket\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267132 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266968 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-credential-socket\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267132 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.266996 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb4n5\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-kube-api-access-wb4n5\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267132 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.267023 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-certs\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267404 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.267195 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-data\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267404 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.267362 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-certs\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267607 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.267586 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istiod-ca-cert\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.267791 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.267771 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-socket\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.268015 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.267992 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-credential-socket\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.269144 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.269123 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-envoy\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.269505 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.269487 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-podinfo\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.315720 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:46.315677 5024 status_manager.go:1045] "Failed to get status for pod" err="pods \"test-curl-9041-19b575\" is forbidden: User \"system:node:ip-10-0-131-64.us-west-1.compute.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-64.us-west-1.compute.internal' and this object" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:46.327465 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.327434 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-token\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.327733 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.327709 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb4n5\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-kube-api-access-wb4n5\") pod \"e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.335401 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.335370 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6af372d4-a8ae-4e22-9514-2869ba241b6d" path="/var/lib/kubelet/pods/6af372d4-a8ae-4e22-9514-2869ba241b6d/volumes" Nov 03 20:06:46.387336 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.387305 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:46.407843 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.407812 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:46.564491 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.564461 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:46.842504 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.842479 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8"] Nov 03 20:06:46.843824 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:06:46.843788 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2f9d73_3d61_4097_8c0d_ad3f90e6def5.slice/crio-0b91bd7fa863735b08dfaa0e36aff304bdbf94326224c6fb9fd3b05f52768eec WatchSource:0}: Error finding container 0b91bd7fa863735b08dfaa0e36aff304bdbf94326224c6fb9fd3b05f52768eec: Status 404 returned error can't find the container with id 0b91bd7fa863735b08dfaa0e36aff304bdbf94326224c6fb9fd3b05f52768eec Nov 03 20:06:46.846259 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.846227 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:06:46.846361 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.846294 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:06:46.846361 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.846337 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:06:46.901101 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:46.901072 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:47.485753 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:47.485728 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" event={"ID":"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5","Type":"ContainerStarted","Data":"917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712"} Nov 03 20:06:47.486062 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:47.485773 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" event={"ID":"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5","Type":"ContainerStarted","Data":"0b91bd7fa863735b08dfaa0e36aff304bdbf94326224c6fb9fd3b05f52768eec"} Nov 03 20:06:47.608377 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:47.608317 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" podStartSLOduration=1.608302844 podStartE2EDuration="1.608302844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:47.605064003 +0000 UTC m=+955.386780669" watchObservedRunningTime="2026-11-03 20:06:47.608302844 +0000 UTC m=+955.390019509" Nov 03 20:06:47.689788 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:47.689765 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:47.782312 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:47.782189 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/766fc244-367f-49c6-97bf-70aca1cf984a-kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/766fc244-367f-49c6-97bf-70aca1cf984a-kube-api-access-nznxq\") pod \"766fc244-367f-49c6-97bf-70aca1cf984a\" (UID: \"766fc244-367f-49c6-97bf-70aca1cf984a\") " Nov 03 20:06:47.784410 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:47.784384 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/766fc244-367f-49c6-97bf-70aca1cf984a-kube-api-access-nznxq" pod "766fc244-367f-49c6-97bf-70aca1cf984a" (UID: "766fc244-367f-49c6-97bf-70aca1cf984a"). InnerVolumeSpecName "kube-api-access-nznxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:06:47.883411 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:47.883376 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nznxq\" (UniqueName: \"kubernetes.io/projected/766fc244-367f-49c6-97bf-70aca1cf984a-kube-api-access-nznxq\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:06:48.340742 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.339979 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="766fc244-367f-49c6-97bf-70aca1cf984a" path="/var/lib/kubelet/pods/766fc244-367f-49c6-97bf-70aca1cf984a/volumes" Nov 03 20:06:48.408008 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.407979 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:48.412695 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.412670 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:48.493668 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.493638 5024 generic.go:356] "Generic (PLEG): container finished" podID="766fc244-367f-49c6-97bf-70aca1cf984a" containerID="961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d" exitCode=137 Nov 03 20:06:48.494169 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.493691 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-9041-19b575" Nov 03 20:06:48.494169 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.493728 5024 scope.go:122] "RemoveContainer" containerID="961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d" Nov 03 20:06:48.494169 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.494046 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:48.495163 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.495017 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:06:48.505989 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.505956 5024 scope.go:122] "RemoveContainer" containerID="961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d" Nov 03 20:06:48.506527 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:06:48.506499 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d\": container with ID starting with 961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d not found: ID does not exist" containerID="961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d" Nov 03 20:06:48.506604 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:48.506537 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d"} err="failed to get container status \"961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d\": rpc error: code = NotFound desc = could not find container \"961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d\": container with ID starting with 961abe119414873260f7d60f2974b02d6860ec87d6dec99160336e11df70482d not found: ID does not exist" Nov 03 20:06:50.536557 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:50.536527 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:50.721069 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:50.721037 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:50.900024 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:50.899996 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:53.782420 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:53.782389 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:53.966288 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:53.966258 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:54.185530 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.185502 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l"] Nov 03 20:06:54.190679 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.190661 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:54.244071 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.244049 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-main-e56f6e\"" Nov 03 20:06:54.247429 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.247394 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l"] Nov 03 20:06:54.346512 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.346480 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a109f2-f69b-4e70-a42e-b01349a1d5da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:54.348199 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.346806 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dktw\" (UniqueName: \"kubernetes.io/projected/f6a109f2-f69b-4e70-a42e-b01349a1d5da-kube-api-access-6dktw\") pod \"payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:54.350279 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.350255 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494"] Nov 03 20:06:54.354876 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.354854 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.381644 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.381619 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494"] Nov 03 20:06:54.407186 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.407156 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-main-e56f6e-dockercfg-b75bt\"" Nov 03 20:06:54.448364 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.448279 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dktw\" (UniqueName: \"kubernetes.io/projected/f6a109f2-f69b-4e70-a42e-b01349a1d5da-kube-api-access-6dktw\") pod \"payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:54.448364 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.448357 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.448542 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.448380 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgmkd\" (UniqueName: \"kubernetes.io/projected/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-kube-api-access-sgmkd\") pod \"payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.448542 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.448509 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a109f2-f69b-4e70-a42e-b01349a1d5da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:54.449186 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.449169 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a109f2-f69b-4e70-a42e-b01349a1d5da-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:54.509433 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.509410 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dktw\" (UniqueName: \"kubernetes.io/projected/f6a109f2-f69b-4e70-a42e-b01349a1d5da-kube-api-access-6dktw\") pod \"payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:54.549499 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.549473 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.549637 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.549507 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgmkd\" (UniqueName: \"kubernetes.io/projected/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-kube-api-access-sgmkd\") pod \"payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.550160 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.550142 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.610488 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.610459 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgmkd\" (UniqueName: \"kubernetes.io/projected/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-kube-api-access-sgmkd\") pod \"payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.667028 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.666999 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:54.803032 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:54.802999 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:55.038709 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:55.038676 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494"] Nov 03 20:06:55.039530 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:06:55.039511 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9b3fb2_19a9_429d_b8e3_fc71be61b1db.slice/crio-162676b72652e011ba493c6c5efa5ffeee7a8f7e7e00acd91f6092173c569dd7 WatchSource:0}: Error finding container 162676b72652e011ba493c6c5efa5ffeee7a8f7e7e00acd91f6092173c569dd7: Status 404 returned error can't find the container with id 162676b72652e011ba493c6c5efa5ffeee7a8f7e7e00acd91f6092173c569dd7 Nov 03 20:06:55.175794 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:55.175767 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l"] Nov 03 20:06:55.176837 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:06:55.176808 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a109f2_f69b_4e70_a42e_b01349a1d5da.slice/crio-2b22f07c410df14d068321ee6a9bea00320f13fcd98d8090ec06b176848d6d2d WatchSource:0}: Error finding container 2b22f07c410df14d068321ee6a9bea00320f13fcd98d8090ec06b176848d6d2d: Status 404 returned error can't find the container with id 2b22f07c410df14d068321ee6a9bea00320f13fcd98d8090ec06b176848d6d2d Nov 03 20:06:55.537068 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:55.537041 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" event={"ID":"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db","Type":"ContainerStarted","Data":"162676b72652e011ba493c6c5efa5ffeee7a8f7e7e00acd91f6092173c569dd7"} Nov 03 20:06:55.538304 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:55.538278 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" event={"ID":"f6a109f2-f69b-4e70-a42e-b01349a1d5da","Type":"ContainerStarted","Data":"2b22f07c410df14d068321ee6a9bea00320f13fcd98d8090ec06b176848d6d2d"} Nov 03 20:06:57.102715 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:57.102678 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:57.276585 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:57.276371 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:57.453579 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:57.453536 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:06:58.561781 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:58.561741 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" event={"ID":"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db","Type":"ContainerStarted","Data":"de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f"} Nov 03 20:06:58.562261 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:58.561811 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:06:58.563338 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:58.563308 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" event={"ID":"f6a109f2-f69b-4e70-a42e-b01349a1d5da","Type":"ContainerStarted","Data":"f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787"} Nov 03 20:06:58.563469 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:58.563386 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:06:58.681139 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:58.681084 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" podStartSLOduration=1.720997286 podStartE2EDuration="4.68106865s" totalImagesPullingTime="2.960071364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:58.677792393 +0000 UTC m=+966.459509061" watchObservedRunningTime="2026-11-03 20:06:58.68106865 +0000 UTC m=+966.462785314" Nov 03 20:06:58.796400 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:06:58.795801 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" podStartSLOduration=2.02711809 podStartE2EDuration="4.79578106s" totalImagesPullingTime="2.76866297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:06:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:06:58.793966145 +0000 UTC m=+966.575682812" watchObservedRunningTime="2026-11-03 20:06:58.79578106 +0000 UTC m=+966.577497726" Nov 03 20:07:02.158722 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:02.158600 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:07.217993 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:07.217957 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:07.593302 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:07:07.593220 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:07:09.579837 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:09.579810 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:07:09.580389 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:09.579876 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:07:12.127798 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:12.127766 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:15.410716 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.410683 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:15.713541 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.713459 5024 generic.go:356] "Generic (PLEG): container finished" podID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerID="917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712" exitCode=0 Nov 03 20:07:15.713541 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.713528 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" event={"ID":"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5","Type":"ContainerDied","Data":"917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712"} Nov 03 20:07:15.713903 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.713891 5024 scope.go:122] "RemoveContainer" containerID="917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712" Nov 03 20:07:15.715056 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.715028 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:15.715147 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.715091 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:15.715147 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.715123 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:15.884495 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:15.884465 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:16.493347 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.493313 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r"] Nov 03 20:07:16.497123 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.497103 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.583951 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.576254 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-main-12288c-openshift-default-dockercfg-z8vnt\"" Nov 03 20:07:16.586517 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.586481 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-credential-socket\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.593997 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.586880 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-data\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.594320 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.594291 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdqdg\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-kube-api-access-wdqdg\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.594463 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.594335 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-envoy\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.594463 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.594357 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-token\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.594463 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.594418 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-podinfo\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.594463 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.594435 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c486a00-f259-4f5b-bab9-ddf48a063854-istiod-ca-cert\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.594463 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.594460 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-socket\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.594726 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.594489 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-certs\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.606043 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.606020 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r"] Nov 03 20:07:16.630413 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.630382 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:16.695624 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695591 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-data\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695624 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695630 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdqdg\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-kube-api-access-wdqdg\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695844 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695653 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-envoy\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695844 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695671 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-token\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695844 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695712 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-podinfo\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695844 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695726 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c486a00-f259-4f5b-bab9-ddf48a063854-istiod-ca-cert\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695844 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695746 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-socket\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695844 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695770 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-certs\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.695844 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.695805 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-credential-socket\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.696204 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.696179 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-credential-socket\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.696474 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.696453 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-socket\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.696818 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.696773 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-data\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.696911 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.696824 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c486a00-f259-4f5b-bab9-ddf48a063854-istiod-ca-cert\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.697078 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.697055 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-certs\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.698809 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.698788 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-envoy\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.699072 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.699040 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-podinfo\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.721808 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.721772 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" event={"ID":"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5","Type":"ContainerStarted","Data":"d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8"} Nov 03 20:07:16.779758 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.779679 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-token\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.780586 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.780557 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdqdg\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-kube-api-access-wdqdg\") pod \"e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.810325 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.810298 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:16.887350 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:16.887315 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:17.278266 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.278217 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r"] Nov 03 20:07:17.288540 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:07:17.288498 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c486a00_f259_4f5b_bab9_ddf48a063854.slice/crio-312408bb5c307f32fbbc78e39ff93b04f946dbaf177df03cfd00829a04b6ee35 WatchSource:0}: Error finding container 312408bb5c307f32fbbc78e39ff93b04f946dbaf177df03cfd00829a04b6ee35: Status 404 returned error can't find the container with id 312408bb5c307f32fbbc78e39ff93b04f946dbaf177df03cfd00829a04b6ee35 Nov 03 20:07:17.291010 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.290979 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:17.291112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.291061 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:17.291112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.291100 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:17.409099 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.408409 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:07:17.410614 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.410588 5024 patch_prober.go:29] interesting pod/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 03 20:07:17.410705 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.410640 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 03 20:07:17.427251 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.427216 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:17.732037 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.732003 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" event={"ID":"6c486a00-f259-4f5b-bab9-ddf48a063854","Type":"ContainerStarted","Data":"534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0"} Nov 03 20:07:17.732423 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.732066 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" event={"ID":"6c486a00-f259-4f5b-bab9-ddf48a063854","Type":"ContainerStarted","Data":"312408bb5c307f32fbbc78e39ff93b04f946dbaf177df03cfd00829a04b6ee35"} Nov 03 20:07:17.810743 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.810717 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:17.852959 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:17.852424 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podStartSLOduration=1.852411884 podStartE2EDuration="1.852411884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:07:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:07:17.852058157 +0000 UTC m=+985.633774823" watchObservedRunningTime="2026-11-03 20:07:17.852411884 +0000 UTC m=+985.634128548" Nov 03 20:07:18.408180 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:18.408146 5024 patch_prober.go:29] interesting pod/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 03 20:07:18.408369 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:18.408211 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 03 20:07:18.494729 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:18.494697 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:07:18.815684 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:18.815601 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:19.408358 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:19.408328 5024 patch_prober.go:29] interesting pod/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 03 20:07:19.408539 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:19.408387 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 03 20:07:19.745710 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:19.745622 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:19.746792 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:19.746771 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:20.408225 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:20.408192 5024 patch_prober.go:29] interesting pod/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 03 20:07:20.408633 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:20.408254 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 03 20:07:20.676568 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:20.676472 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:20.865070 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:20.865018 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:21.050525 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:21.050364 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:21.408372 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:21.408224 5024 patch_prober.go:29] interesting pod/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Nov 03 20:07:21.408372 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:21.408292 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Nov 03 20:07:22.412136 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:22.412109 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:07:22.413030 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:22.413013 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:07:22.604294 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:22.604258 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:23.875966 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:23.875891 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:24.081328 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.081298 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:24.266288 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.266253 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g"] Nov 03 20:07:24.270760 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.270745 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.290720 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.290695 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:24.372705 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.372667 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c582-ead6-42d1-b34c-efcb13167941-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.372960 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.372794 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmvd8\" (UniqueName: \"kubernetes.io/projected/5f56c582-ead6-42d1-b34c-efcb13167941-kube-api-access-kmvd8\") pod \"payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.375220 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.375193 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-main-12288c-dockercfg-c6472\"" Nov 03 20:07:24.375412 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.375390 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-main-12288c\"" Nov 03 20:07:24.380064 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.380039 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g"] Nov 03 20:07:24.473490 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.473462 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmvd8\" (UniqueName: \"kubernetes.io/projected/5f56c582-ead6-42d1-b34c-efcb13167941-kube-api-access-kmvd8\") pod \"payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.473687 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.473541 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c582-ead6-42d1-b34c-efcb13167941-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.474296 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.474276 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c582-ead6-42d1-b34c-efcb13167941-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.494884 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.494857 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:24.562568 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.562498 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmvd8\" (UniqueName: \"kubernetes.io/projected/5f56c582-ead6-42d1-b34c-efcb13167941-kube-api-access-kmvd8\") pod \"payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.584377 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.584334 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:24.961807 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:07:24.961781 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f56c582_ead6_42d1_b34c_efcb13167941.slice/crio-f4b617578e0a1f45829b3bedc342d56ab882d06697c1d229122d6e48939b0665 WatchSource:0}: Error finding container f4b617578e0a1f45829b3bedc342d56ab882d06697c1d229122d6e48939b0665: Status 404 returned error can't find the container with id f4b617578e0a1f45829b3bedc342d56ab882d06697c1d229122d6e48939b0665 Nov 03 20:07:24.962650 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:24.962620 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g"] Nov 03 20:07:25.784999 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:25.784959 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" event={"ID":"5f56c582-ead6-42d1-b34c-efcb13167941","Type":"ContainerStarted","Data":"61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d"} Nov 03 20:07:25.785149 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:25.785053 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" event={"ID":"5f56c582-ead6-42d1-b34c-efcb13167941","Type":"ContainerStarted","Data":"f4b617578e0a1f45829b3bedc342d56ab882d06697c1d229122d6e48939b0665"} Nov 03 20:07:25.785149 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:25.785082 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:25.902385 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:25.902330 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" podStartSLOduration=1.902316498 podStartE2EDuration="1.902316498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:07:25.90034222 +0000 UTC m=+993.682058884" watchObservedRunningTime="2026-11-03 20:07:25.902316498 +0000 UTC m=+993.684033164" Nov 03 20:07:27.541184 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:27.541148 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:32.282531 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:32.282502 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:32.464112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:32.464074 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:32.633723 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:32.633622 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:36.794131 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:36.794103 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:07:37.319629 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:37.319598 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:37.571093 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:07:37.571014 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:07:42.337232 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:42.337201 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:47.220225 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:47.220192 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:47.402406 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:47.402368 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:49.818003 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.817626 5024 patch_prober.go:29] interesting pod/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:51608->10.132.0.70:15021: read: connection reset by peer" start-of-body= Nov 03 20:07:49.818003 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.817704 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": read tcp 10.132.0.2:51608->10.132.0.70:15021: read: connection reset by peer" Nov 03 20:07:49.943204 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.943170 5024 generic.go:356] "Generic (PLEG): container finished" podID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerID="534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0" exitCode=0 Nov 03 20:07:49.943390 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.943222 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" event={"ID":"6c486a00-f259-4f5b-bab9-ddf48a063854","Type":"ContainerDied","Data":"534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0"} Nov 03 20:07:49.943638 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.943620 5024 scope.go:122] "RemoveContainer" containerID="534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0" Nov 03 20:07:49.944754 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.944727 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:49.944819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.944793 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:49.944866 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:49.944824 5024 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"} Nov 03 20:07:50.950974 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:50.950915 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" event={"ID":"6c486a00-f259-4f5b-bab9-ddf48a063854","Type":"ContainerStarted","Data":"685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce"} Nov 03 20:07:51.811264 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:51.811232 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:51.811431 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:51.811405 5024 patch_prober.go:29] interesting pod/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 03 20:07:51.811476 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:51.811450 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 03 20:07:52.129176 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:52.129099 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:52.811082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:52.811049 5024 patch_prober.go:29] interesting pod/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 03 20:07:52.811283 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:52.811101 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 03 20:07:53.811018 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:53.810982 5024 patch_prober.go:29] interesting pod/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 03 20:07:53.811417 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:53.811051 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 03 20:07:54.810763 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:54.810727 5024 patch_prober.go:29] interesting pod/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 03 20:07:54.810969 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:54.810781 5024 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 03 20:07:55.896250 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:55.896208 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:56.043120 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:56.043054 5024 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:56.043641 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:56.043626 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:56.044523 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:56.044501 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:07:57.358007 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:57.357969 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:07:59.187819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:07:59.187789 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:02.245599 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:02.245525 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:07.108907 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:07.108867 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:07.570781 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:08:07.570744 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:08:12.016790 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:12.016756 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:16.936306 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:16.936272 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:21.824997 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:21.824965 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:26.730193 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:26.730158 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:31.398978 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:31.398906 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:31.626271 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:31.626232 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:36.528992 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:36.528956 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:37.570823 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:08:37.570791 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:08:41.528277 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:41.528250 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:46.423597 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:46.423562 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:47.589857 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:47.589813 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:51.315892 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:51.315852 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:08:56.247510 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:08:56.247323 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:01.132739 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:01.132696 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:02.685677 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.685624 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl"] Nov 03 20:09:02.690619 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.690596 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.742708 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.742682 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl"] Nov 03 20:09:02.755252 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.755221 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.755360 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.755264 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-xks-ca\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.755404 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.755364 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7znwg\" (UniqueName: \"kubernetes.io/projected/06d5a976-9b98-4f8f-a038-48daef90f354-kube-api-access-7znwg\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.788849 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.788820 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:09:02.788991 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.788876 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:09:02.856562 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.856537 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.856690 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.856567 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-xks-ca\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.856690 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.856591 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7znwg\" (UniqueName: \"kubernetes.io/projected/06d5a976-9b98-4f8f-a038-48daef90f354-kube-api-access-7znwg\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.857223 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.857196 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.859203 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.859175 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-xks-ca\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:02.917709 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:02.917683 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7znwg\" (UniqueName: \"kubernetes.io/projected/06d5a976-9b98-4f8f-a038-48daef90f354-kube-api-access-7znwg\") pod \"maas-api-revoke-sub-28a610b5-9mwvl\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:03.003304 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:03.003227 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:03.374131 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:03.374105 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl"] Nov 03 20:09:03.375423 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:09:03.375401 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d5a976_9b98_4f8f_a038_48daef90f354.slice/crio-27380368fcd2114a72069f868e865c740209a6658479f3b660af4707923d9eeb WatchSource:0}: Error finding container 27380368fcd2114a72069f868e865c740209a6658479f3b660af4707923d9eeb: Status 404 returned error can't find the container with id 27380368fcd2114a72069f868e865c740209a6658479f3b660af4707923d9eeb Nov 03 20:09:03.413522 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:03.413497 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" event={"ID":"06d5a976-9b98-4f8f-a038-48daef90f354","Type":"ContainerStarted","Data":"27380368fcd2114a72069f868e865c740209a6658479f3b660af4707923d9eeb"} Nov 03 20:09:04.421627 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:04.421594 5024 generic.go:356] "Generic (PLEG): container finished" podID="06d5a976-9b98-4f8f-a038-48daef90f354" containerID="e473f6cf57bada3cc39877f8e9d1fb2f78eb4d45c1acf6c07a583525faf80095" exitCode=0 Nov 03 20:09:04.421627 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:04.421629 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" event={"ID":"06d5a976-9b98-4f8f-a038-48daef90f354","Type":"ContainerDied","Data":"e473f6cf57bada3cc39877f8e9d1fb2f78eb4d45c1acf6c07a583525faf80095"} Nov 03 20:09:05.570626 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.570599 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:05.686311 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.685677 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-xks-ca\") pod \"06d5a976-9b98-4f8f-a038-48daef90f354\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " Nov 03 20:09:05.686311 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.685789 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-openshift-ca\") pod \"06d5a976-9b98-4f8f-a038-48daef90f354\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " Nov 03 20:09:05.686311 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.685830 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/06d5a976-9b98-4f8f-a038-48daef90f354-kube-api-access-7znwg\" (UniqueName: \"kubernetes.io/projected/06d5a976-9b98-4f8f-a038-48daef90f354-kube-api-access-7znwg\") pod \"06d5a976-9b98-4f8f-a038-48daef90f354\" (UID: \"06d5a976-9b98-4f8f-a038-48daef90f354\") " Nov 03 20:09:05.686311 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.686256 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-openshift-ca" pod "06d5a976-9b98-4f8f-a038-48daef90f354" (UID: "06d5a976-9b98-4f8f-a038-48daef90f354"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:09:05.688412 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.688368 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-xks-ca" pod "06d5a976-9b98-4f8f-a038-48daef90f354" (UID: "06d5a976-9b98-4f8f-a038-48daef90f354"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:09:05.688587 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.688563 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06d5a976-9b98-4f8f-a038-48daef90f354-kube-api-access-7znwg" pod "06d5a976-9b98-4f8f-a038-48daef90f354" (UID: "06d5a976-9b98-4f8f-a038-48daef90f354"). InnerVolumeSpecName "kube-api-access-7znwg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:09:05.787266 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.787236 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:05.787266 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.787260 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/06d5a976-9b98-4f8f-a038-48daef90f354-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:05.787266 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:05.787269 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7znwg\" (UniqueName: \"kubernetes.io/projected/06d5a976-9b98-4f8f-a038-48daef90f354-kube-api-access-7znwg\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:06.021868 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:06.021789 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:06.436034 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:06.436006 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" Nov 03 20:09:06.436210 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:06.436011 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl" event={"ID":"06d5a976-9b98-4f8f-a038-48daef90f354","Type":"ContainerDied","Data":"27380368fcd2114a72069f868e865c740209a6658479f3b660af4707923d9eeb"} Nov 03 20:09:06.436210 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:06.436113 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27380368fcd2114a72069f868e865c740209a6658479f3b660af4707923d9eeb" Nov 03 20:09:07.571359 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:09:07.571315 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:09:09.076573 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:09.076541 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:11.020202 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:11.020169 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:15.777763 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:15.777728 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:15.960491 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:15.960442 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:17.811914 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.811880 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7"] Nov 03 20:09:17.812543 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.812524 5024 cpu_manager.go:414] "containerMap: removing container" podUID="06d5a976-9b98-4f8f-a038-48daef90f354" containerName="revoke-keys" Nov 03 20:09:17.812609 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.812548 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="06d5a976-9b98-4f8f-a038-48daef90f354" containerName="revoke-keys" Nov 03 20:09:17.812693 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.812682 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="06d5a976-9b98-4f8f-a038-48daef90f354" containerName="revoke-keys" Nov 03 20:09:17.816072 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.816057 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:17.869680 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.869645 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:09:17.903581 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.903545 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjnh7\" (UniqueName: \"kubernetes.io/projected/7b6ce255-74f2-47c2-ab72-13174bcbdfef-kube-api-access-gjnh7\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:17.903788 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.903614 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:17.903865 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.903810 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-xks-ca\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:17.919706 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.919667 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:09:17.926690 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:17.926655 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7"] Nov 03 20:09:18.004572 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.004539 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-xks-ca\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:18.004774 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.004594 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjnh7\" (UniqueName: \"kubernetes.io/projected/7b6ce255-74f2-47c2-ab72-13174bcbdfef-kube-api-access-gjnh7\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:18.004774 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.004636 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:18.005321 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.005301 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:18.007075 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.007052 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-xks-ca\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:18.065759 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.065677 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjnh7\" (UniqueName: \"kubernetes.io/projected/7b6ce255-74f2-47c2-ab72-13174bcbdfef-kube-api-access-gjnh7\") pod \"maas-api-revoke-sub-40b5ab3d-mtxt7\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:18.130091 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.130045 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:18.508731 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:18.508699 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7"] Nov 03 20:09:18.510307 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:09:18.510273 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b6ce255_74f2_47c2_ab72_13174bcbdfef.slice/crio-dd476de44743dd55dc4c623291b4cc2569673bf4321b80cb076ba5661df3e429 WatchSource:0}: Error finding container dd476de44743dd55dc4c623291b4cc2569673bf4321b80cb076ba5661df3e429: Status 404 returned error can't find the container with id dd476de44743dd55dc4c623291b4cc2569673bf4321b80cb076ba5661df3e429 Nov 03 20:09:19.523427 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:19.523396 5024 generic.go:356] "Generic (PLEG): container finished" podID="7b6ce255-74f2-47c2-ab72-13174bcbdfef" containerID="81bb7955dd2da7b882c9540988e4418268d5bf9addee4bbcd9759dcca05c90b4" exitCode=0 Nov 03 20:09:19.523812 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:19.523482 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" event={"ID":"7b6ce255-74f2-47c2-ab72-13174bcbdfef","Type":"ContainerDied","Data":"81bb7955dd2da7b882c9540988e4418268d5bf9addee4bbcd9759dcca05c90b4"} Nov 03 20:09:19.523812 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:19.523535 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" event={"ID":"7b6ce255-74f2-47c2-ab72-13174bcbdfef","Type":"ContainerStarted","Data":"dd476de44743dd55dc4c623291b4cc2569673bf4321b80cb076ba5661df3e429"} Nov 03 20:09:20.670891 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.670867 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:20.728334 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.728298 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7b6ce255-74f2-47c2-ab72-13174bcbdfef-kube-api-access-gjnh7\" (UniqueName: \"kubernetes.io/projected/7b6ce255-74f2-47c2-ab72-13174bcbdfef-kube-api-access-gjnh7\") pod \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " Nov 03 20:09:20.728522 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.728356 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-openshift-ca\") pod \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " Nov 03 20:09:20.728522 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.728428 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-xks-ca\") pod \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\" (UID: \"7b6ce255-74f2-47c2-ab72-13174bcbdfef\") " Nov 03 20:09:20.728738 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.728710 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-openshift-ca" pod "7b6ce255-74f2-47c2-ab72-13174bcbdfef" (UID: "7b6ce255-74f2-47c2-ab72-13174bcbdfef"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:09:20.730631 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.730604 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b6ce255-74f2-47c2-ab72-13174bcbdfef-kube-api-access-gjnh7" pod "7b6ce255-74f2-47c2-ab72-13174bcbdfef" (UID: "7b6ce255-74f2-47c2-ab72-13174bcbdfef"). InnerVolumeSpecName "kube-api-access-gjnh7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:09:20.730727 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.730638 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-xks-ca" pod "7b6ce255-74f2-47c2-ab72-13174bcbdfef" (UID: "7b6ce255-74f2-47c2-ab72-13174bcbdfef"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:09:20.826835 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.826742 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:20.836397 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.836356 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjnh7\" (UniqueName: \"kubernetes.io/projected/7b6ce255-74f2-47c2-ab72-13174bcbdfef-kube-api-access-gjnh7\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:20.836397 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.836398 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:20.836686 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:20.836413 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7b6ce255-74f2-47c2-ab72-13174bcbdfef-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:21.538906 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:21.538871 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" Nov 03 20:09:21.538906 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:21.538896 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7" event={"ID":"7b6ce255-74f2-47c2-ab72-13174bcbdfef","Type":"ContainerDied","Data":"dd476de44743dd55dc4c623291b4cc2569673bf4321b80cb076ba5661df3e429"} Nov 03 20:09:21.539137 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:21.538968 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd476de44743dd55dc4c623291b4cc2569673bf4321b80cb076ba5661df3e429" Nov 03 20:09:25.738802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:25.738771 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:28.687203 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.687166 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv"] Nov 03 20:09:28.687629 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.687616 5024 cpu_manager.go:414] "containerMap: removing container" podUID="7b6ce255-74f2-47c2-ab72-13174bcbdfef" containerName="revoke-keys" Nov 03 20:09:28.687671 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.687629 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7b6ce255-74f2-47c2-ab72-13174bcbdfef" containerName="revoke-keys" Nov 03 20:09:28.687728 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.687720 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="7b6ce255-74f2-47c2-ab72-13174bcbdfef" containerName="revoke-keys" Nov 03 20:09:28.691036 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.691021 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.744491 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.744456 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:09:28.794044 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.794011 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:09:28.797175 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.797157 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv"] Nov 03 20:09:28.821217 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.821190 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.821450 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.821379 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvfdp\" (UniqueName: \"kubernetes.io/projected/0c120d25-fe1a-4949-a1ae-927fa64af31e-kube-api-access-mvfdp\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.821450 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.821438 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.922543 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.922506 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.922881 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.922863 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvfdp\" (UniqueName: \"kubernetes.io/projected/0c120d25-fe1a-4949-a1ae-927fa64af31e-kube-api-access-mvfdp\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.923165 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.923148 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.923338 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.923315 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.927361 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.927285 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:28.984980 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:28.984856 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvfdp\" (UniqueName: \"kubernetes.io/projected/0c120d25-fe1a-4949-a1ae-927fa64af31e-kube-api-access-mvfdp\") pod \"maas-api-revoke-sub-f719a87a-wnhjv\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:29.003633 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:29.003597 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:29.408613 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:29.408412 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv"] Nov 03 20:09:29.410307 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:09:29.409216 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c120d25_fe1a_4949_a1ae_927fa64af31e.slice/crio-281796218f91eb07be360d456035dedf540d63b78d627c5115e83280532acf84 WatchSource:0}: Error finding container 281796218f91eb07be360d456035dedf540d63b78d627c5115e83280532acf84: Status 404 returned error can't find the container with id 281796218f91eb07be360d456035dedf540d63b78d627c5115e83280532acf84 Nov 03 20:09:29.595588 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:29.595546 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" event={"ID":"0c120d25-fe1a-4949-a1ae-927fa64af31e","Type":"ContainerStarted","Data":"281796218f91eb07be360d456035dedf540d63b78d627c5115e83280532acf84"} Nov 03 20:09:30.638630 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:30.638049 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" event={"ID":"0c120d25-fe1a-4949-a1ae-927fa64af31e","Type":"ContainerStarted","Data":"7ab28739d27033319b7737b44dbd1ba7d5b34a96f9d06b685847d3da553a21cf"} Nov 03 20:09:30.679137 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:30.677863 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:30.782953 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:30.769728 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" podStartSLOduration=2.769707673 podStartE2EDuration="2.769707673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:09:30.768343358 +0000 UTC m=+1118.550060023" watchObservedRunningTime="2026-11-03 20:09:30.769707673 +0000 UTC m=+1118.551424339" Nov 03 20:09:31.717832 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:31.717796 5024 generic.go:356] "Generic (PLEG): container finished" podID="0c120d25-fe1a-4949-a1ae-927fa64af31e" containerID="7ab28739d27033319b7737b44dbd1ba7d5b34a96f9d06b685847d3da553a21cf" exitCode=0 Nov 03 20:09:31.718545 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:31.718518 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" event={"ID":"0c120d25-fe1a-4949-a1ae-927fa64af31e","Type":"ContainerDied","Data":"7ab28739d27033319b7737b44dbd1ba7d5b34a96f9d06b685847d3da553a21cf"} Nov 03 20:09:32.892971 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:32.892946 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:33.010762 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.010670 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-openshift-ca\") pod \"0c120d25-fe1a-4949-a1ae-927fa64af31e\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " Nov 03 20:09:33.010762 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.010738 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-xks-ca\") pod \"0c120d25-fe1a-4949-a1ae-927fa64af31e\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " Nov 03 20:09:33.011022 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.010799 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0c120d25-fe1a-4949-a1ae-927fa64af31e-kube-api-access-mvfdp\" (UniqueName: \"kubernetes.io/projected/0c120d25-fe1a-4949-a1ae-927fa64af31e-kube-api-access-mvfdp\") pod \"0c120d25-fe1a-4949-a1ae-927fa64af31e\" (UID: \"0c120d25-fe1a-4949-a1ae-927fa64af31e\") " Nov 03 20:09:33.011144 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.011119 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-openshift-ca" pod "0c120d25-fe1a-4949-a1ae-927fa64af31e" (UID: "0c120d25-fe1a-4949-a1ae-927fa64af31e"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:09:33.011314 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.011298 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:33.013270 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.013245 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c120d25-fe1a-4949-a1ae-927fa64af31e-kube-api-access-mvfdp" pod "0c120d25-fe1a-4949-a1ae-927fa64af31e" (UID: "0c120d25-fe1a-4949-a1ae-927fa64af31e"). InnerVolumeSpecName "kube-api-access-mvfdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:09:33.013402 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.013386 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-xks-ca" pod "0c120d25-fe1a-4949-a1ae-927fa64af31e" (UID: "0c120d25-fe1a-4949-a1ae-927fa64af31e"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:09:33.112869 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.112836 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0c120d25-fe1a-4949-a1ae-927fa64af31e-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:33.112869 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.112869 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvfdp\" (UniqueName: \"kubernetes.io/projected/0c120d25-fe1a-4949-a1ae-927fa64af31e-kube-api-access-mvfdp\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:33.734478 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.734445 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" Nov 03 20:09:33.734668 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.734476 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv" event={"ID":"0c120d25-fe1a-4949-a1ae-927fa64af31e","Type":"ContainerDied","Data":"281796218f91eb07be360d456035dedf540d63b78d627c5115e83280532acf84"} Nov 03 20:09:33.734668 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:33.734561 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="281796218f91eb07be360d456035dedf540d63b78d627c5115e83280532acf84" Nov 03 20:09:34.059636 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:34.059540 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk"] Nov 03 20:09:34.062735 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:34.062713 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6e268dd5-cdvbk"] Nov 03 20:09:34.334798 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:34.334724 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a46b744c-7240-4fae-a707-4d53a9f8fa05" path="/var/lib/kubelet/pods/a46b744c-7240-4fae-a707-4d53a9f8fa05/volumes" Nov 03 20:09:35.631011 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:35.630972 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:37.706961 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:09:37.706319 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:09:39.346804 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.346766 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh"] Nov 03 20:09:39.347449 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.347429 5024 cpu_manager.go:414] "containerMap: removing container" podUID="0c120d25-fe1a-4949-a1ae-927fa64af31e" containerName="revoke-keys" Nov 03 20:09:39.347536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.347451 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0c120d25-fe1a-4949-a1ae-927fa64af31e" containerName="revoke-keys" Nov 03 20:09:39.347622 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.347609 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="0c120d25-fe1a-4949-a1ae-927fa64af31e" containerName="revoke-keys" Nov 03 20:09:39.350569 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.350550 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.404496 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.404466 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:09:39.453865 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.453829 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:09:39.457238 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.457219 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh"] Nov 03 20:09:39.489875 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.489848 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3e570d22-b598-4098-834b-529901eadcb1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.490052 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.489884 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3e570d22-b598-4098-834b-529901eadcb1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.490100 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.490074 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hccr9\" (UniqueName: \"kubernetes.io/projected/3e570d22-b598-4098-834b-529901eadcb1-kube-api-access-hccr9\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.591365 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.591328 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hccr9\" (UniqueName: \"kubernetes.io/projected/3e570d22-b598-4098-834b-529901eadcb1-kube-api-access-hccr9\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.591538 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.591389 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3e570d22-b598-4098-834b-529901eadcb1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.591538 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.591424 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3e570d22-b598-4098-834b-529901eadcb1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.592280 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.592256 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3e570d22-b598-4098-834b-529901eadcb1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.593821 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.593803 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3e570d22-b598-4098-834b-529901eadcb1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.652176 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.652152 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hccr9\" (UniqueName: \"kubernetes.io/projected/3e570d22-b598-4098-834b-529901eadcb1-kube-api-access-hccr9\") pod \"maas-api-revoke-sub-d6a644bc-t7jfh\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:39.663004 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:39.662986 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:40.039312 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:40.039265 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh"] Nov 03 20:09:40.039757 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:09:40.039732 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e570d22_b598_4098_834b_529901eadcb1.slice/crio-77956368f7a3a5dd03398c6af2c515e26eeda8a3673840a65bfbfcab4b8533e0 WatchSource:0}: Error finding container 77956368f7a3a5dd03398c6af2c515e26eeda8a3673840a65bfbfcab4b8533e0: Status 404 returned error can't find the container with id 77956368f7a3a5dd03398c6af2c515e26eeda8a3673840a65bfbfcab4b8533e0 Nov 03 20:09:40.736473 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:40.736414 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:40.822768 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:40.822733 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" event={"ID":"3e570d22-b598-4098-834b-529901eadcb1","Type":"ContainerStarted","Data":"d875452ff4c13d6489f2013ad2356bb13f82853973f33457ebce25ac21a27e89"} Nov 03 20:09:40.822963 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:40.822783 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" event={"ID":"3e570d22-b598-4098-834b-529901eadcb1","Type":"ContainerStarted","Data":"77956368f7a3a5dd03398c6af2c515e26eeda8a3673840a65bfbfcab4b8533e0"} Nov 03 20:09:40.938445 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:40.938390 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" podStartSLOduration=1.93837797 podStartE2EDuration="1.93837797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:09:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:09:40.937668434 +0000 UTC m=+1128.719385099" watchObservedRunningTime="2026-11-03 20:09:40.93837797 +0000 UTC m=+1128.720094662" Nov 03 20:09:41.048197 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:41.048109 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6"] Nov 03 20:09:41.051081 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:41.051054 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f957dce9-v8tp6"] Nov 03 20:09:41.830708 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:41.830676 5024 generic.go:356] "Generic (PLEG): container finished" podID="3e570d22-b598-4098-834b-529901eadcb1" containerID="d875452ff4c13d6489f2013ad2356bb13f82853973f33457ebce25ac21a27e89" exitCode=0 Nov 03 20:09:41.831222 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:41.830758 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" event={"ID":"3e570d22-b598-4098-834b-529901eadcb1","Type":"ContainerDied","Data":"d875452ff4c13d6489f2013ad2356bb13f82853973f33457ebce25ac21a27e89"} Nov 03 20:09:42.334222 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:42.334185 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0589ccd6-508b-4d52-92fc-fb2885665bc4" path="/var/lib/kubelet/pods/0589ccd6-508b-4d52-92fc-fb2885665bc4/volumes" Nov 03 20:09:42.967289 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:42.967259 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:43.026751 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.026715 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e570d22-b598-4098-834b-529901eadcb1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3e570d22-b598-4098-834b-529901eadcb1-maas-api-openshift-ca\") pod \"3e570d22-b598-4098-834b-529901eadcb1\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " Nov 03 20:09:43.026954 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.026778 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e570d22-b598-4098-834b-529901eadcb1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3e570d22-b598-4098-834b-529901eadcb1-maas-api-xks-ca\") pod \"3e570d22-b598-4098-834b-529901eadcb1\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " Nov 03 20:09:43.026954 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.026825 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e570d22-b598-4098-834b-529901eadcb1-kube-api-access-hccr9\" (UniqueName: \"kubernetes.io/projected/3e570d22-b598-4098-834b-529901eadcb1-kube-api-access-hccr9\") pod \"3e570d22-b598-4098-834b-529901eadcb1\" (UID: \"3e570d22-b598-4098-834b-529901eadcb1\") " Nov 03 20:09:43.027185 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.027158 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e570d22-b598-4098-834b-529901eadcb1-maas-api-openshift-ca" pod "3e570d22-b598-4098-834b-529901eadcb1" (UID: "3e570d22-b598-4098-834b-529901eadcb1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:09:43.027277 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.027263 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3e570d22-b598-4098-834b-529901eadcb1-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:43.029134 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.029106 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e570d22-b598-4098-834b-529901eadcb1-kube-api-access-hccr9" pod "3e570d22-b598-4098-834b-529901eadcb1" (UID: "3e570d22-b598-4098-834b-529901eadcb1"). InnerVolumeSpecName "kube-api-access-hccr9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:09:43.029134 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.029112 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e570d22-b598-4098-834b-529901eadcb1-maas-api-xks-ca" pod "3e570d22-b598-4098-834b-529901eadcb1" (UID: "3e570d22-b598-4098-834b-529901eadcb1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:09:43.128856 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.128776 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3e570d22-b598-4098-834b-529901eadcb1-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:43.128856 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.128806 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hccr9\" (UniqueName: \"kubernetes.io/projected/3e570d22-b598-4098-834b-529901eadcb1-kube-api-access-hccr9\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:43.843856 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.843822 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" Nov 03 20:09:43.844073 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.843824 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh" event={"ID":"3e570d22-b598-4098-834b-529901eadcb1","Type":"ContainerDied","Data":"77956368f7a3a5dd03398c6af2c515e26eeda8a3673840a65bfbfcab4b8533e0"} Nov 03 20:09:43.844073 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:43.843966 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77956368f7a3a5dd03398c6af2c515e26eeda8a3673840a65bfbfcab4b8533e0" Nov 03 20:09:45.624344 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:45.624313 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:46.005121 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.005084 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-rz4p4-rb7lq"] Nov 03 20:09:46.005580 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.005568 5024 cpu_manager.go:414] "containerMap: removing container" podUID="3e570d22-b598-4098-834b-529901eadcb1" containerName="revoke-keys" Nov 03 20:09:46.005628 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.005582 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e570d22-b598-4098-834b-529901eadcb1" containerName="revoke-keys" Nov 03 20:09:46.005675 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.005665 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e570d22-b598-4098-834b-529901eadcb1" containerName="revoke-keys" Nov 03 20:09:46.008968 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.008953 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.112626 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.112592 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5c7z7\"" Nov 03 20:09:46.115810 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.115780 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-rz4p4-rb7lq"] Nov 03 20:09:46.157896 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.157856 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc75k\" (UniqueName: \"kubernetes.io/projected/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-kube-api-access-rc75k\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.158112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.157919 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-trusted-ca-bundle\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.158112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.158096 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-archives-path\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.158234 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.158122 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-service-ca-bundle\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.259491 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.259388 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc75k\" (UniqueName: \"kubernetes.io/projected/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-kube-api-access-rc75k\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.259491 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.259470 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-trusted-ca-bundle\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.259708 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.259522 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-archives-path\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.259708 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.259542 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-service-ca-bundle\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.259885 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.259865 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-archives-path\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.260183 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.260167 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-service-ca-bundle\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.260294 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.260276 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-trusted-ca-bundle\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.321004 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.320971 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc75k\" (UniqueName: \"kubernetes.io/projected/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-kube-api-access-rc75k\") pod \"periodic-gathering-rz4p4-rb7lq\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.321199 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.321159 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:09:46.698360 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.698330 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-rz4p4-rb7lq"] Nov 03 20:09:46.699389 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:09:46.699345 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7fda61_28fe_4e0d_b554_2046aac2f8ee.slice/crio-6e33dcc3f5f2a3ebfde9418e467e296aceddab2cee03877df02f99a3c50bb53b WatchSource:0}: Error finding container 6e33dcc3f5f2a3ebfde9418e467e296aceddab2cee03877df02f99a3c50bb53b: Status 404 returned error can't find the container with id 6e33dcc3f5f2a3ebfde9418e467e296aceddab2cee03877df02f99a3c50bb53b Nov 03 20:09:46.867449 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.867414 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" event={"ID":"cf7fda61-28fe-4e0d-b554-2046aac2f8ee","Type":"ContainerStarted","Data":"012dfdad4412c735282273372968af8ca22856caaf9fe425449c90b568186932"} Nov 03 20:09:46.867657 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.867471 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" event={"ID":"cf7fda61-28fe-4e0d-b554-2046aac2f8ee","Type":"ContainerStarted","Data":"6e33dcc3f5f2a3ebfde9418e467e296aceddab2cee03877df02f99a3c50bb53b"} Nov 03 20:09:46.983779 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:46.983673 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" podStartSLOduration=1.983659999 podStartE2EDuration="1.983659999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:09:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:09:46.982485059 +0000 UTC m=+1134.764201726" watchObservedRunningTime="2026-11-03 20:09:46.983659999 +0000 UTC m=+1134.765376665" Nov 03 20:09:47.945549 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:47.945513 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:50.025325 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.025282 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5"] Nov 03 20:09:50.051371 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.051321 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.127218 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.127181 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:09:50.151820 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.151770 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.155320 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.155292 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkr4\" (UniqueName: \"kubernetes.io/projected/a8aeb621-0ec1-4163-b78e-486181a71715-kube-api-access-jxkr4\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.155536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.155510 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-xks-ca\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.165089 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.165059 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:09:50.187594 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.187553 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5"] Nov 03 20:09:50.263532 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.263489 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.272107 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.272067 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkr4\" (UniqueName: \"kubernetes.io/projected/a8aeb621-0ec1-4163-b78e-486181a71715-kube-api-access-jxkr4\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.272381 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.272362 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-xks-ca\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.324006 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.320314 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.602015 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.601872 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkr4\" (UniqueName: \"kubernetes.io/projected/a8aeb621-0ec1-4163-b78e-486181a71715-kube-api-access-jxkr4\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.659959 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.653625 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-xks-ca\") pod \"maas-api-revoke-sub-73050a3f-z8zv5\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.712953 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.710251 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:50.712953 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.710643 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:09:50.712953 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.710714 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:09:50.726570 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:50.726535 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:09:51.361732 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:51.361702 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5"] Nov 03 20:09:51.362539 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:09:51.362515 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8aeb621_0ec1_4163_b78e_486181a71715.slice/crio-9496cae38e672aec14d929f8871b21ba936f73cc275240ddf5f2bd87c67c3d71 WatchSource:0}: Error finding container 9496cae38e672aec14d929f8871b21ba936f73cc275240ddf5f2bd87c67c3d71: Status 404 returned error can't find the container with id 9496cae38e672aec14d929f8871b21ba936f73cc275240ddf5f2bd87c67c3d71 Nov 03 20:09:51.946626 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:51.946530 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" event={"ID":"a8aeb621-0ec1-4163-b78e-486181a71715","Type":"ContainerStarted","Data":"1955b98b006486faf55674334d232870d3d3ae552dcb5ac398542d4b041191e5"} Nov 03 20:09:51.946626 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:51.946580 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" event={"ID":"a8aeb621-0ec1-4163-b78e-486181a71715","Type":"ContainerStarted","Data":"9496cae38e672aec14d929f8871b21ba936f73cc275240ddf5f2bd87c67c3d71"} Nov 03 20:09:52.051593 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:52.051559 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84"] Nov 03 20:09:52.054365 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:52.054347 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8e501c84-jsd84"] Nov 03 20:09:52.098024 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:52.097977 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" podStartSLOduration=3.097962828 podStartE2EDuration="3.097962828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:09:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:09:52.095266968 +0000 UTC m=+1139.876983648" watchObservedRunningTime="2026-11-03 20:09:52.097962828 +0000 UTC m=+1139.879679488" Nov 03 20:09:52.335605 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:52.335524 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0443e325-d932-4a37-9edd-affd32ed332c" path="/var/lib/kubelet/pods/0443e325-d932-4a37-9edd-affd32ed332c/volumes" Nov 03 20:09:52.954667 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:52.954632 5024 generic.go:356] "Generic (PLEG): container finished" podID="a8aeb621-0ec1-4163-b78e-486181a71715" containerID="1955b98b006486faf55674334d232870d3d3ae552dcb5ac398542d4b041191e5" exitCode=0 Nov 03 20:09:52.955118 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:52.954716 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" event={"ID":"a8aeb621-0ec1-4163-b78e-486181a71715","Type":"ContainerDied","Data":"1955b98b006486faf55674334d232870d3d3ae552dcb5ac398542d4b041191e5"} Nov 03 20:09:54.104524 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.104494 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:54.140556 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.140522 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-openshift-ca\") pod \"a8aeb621-0ec1-4163-b78e-486181a71715\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " Nov 03 20:09:54.140760 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.140633 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8aeb621-0ec1-4163-b78e-486181a71715-kube-api-access-jxkr4\" (UniqueName: \"kubernetes.io/projected/a8aeb621-0ec1-4163-b78e-486181a71715-kube-api-access-jxkr4\") pod \"a8aeb621-0ec1-4163-b78e-486181a71715\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " Nov 03 20:09:54.140760 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.140676 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-xks-ca\") pod \"a8aeb621-0ec1-4163-b78e-486181a71715\" (UID: \"a8aeb621-0ec1-4163-b78e-486181a71715\") " Nov 03 20:09:54.141000 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.140973 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-openshift-ca" pod "a8aeb621-0ec1-4163-b78e-486181a71715" (UID: "a8aeb621-0ec1-4163-b78e-486181a71715"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:09:54.142780 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.142753 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-xks-ca" pod "a8aeb621-0ec1-4163-b78e-486181a71715" (UID: "a8aeb621-0ec1-4163-b78e-486181a71715"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:09:54.142901 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.142879 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8aeb621-0ec1-4163-b78e-486181a71715-kube-api-access-jxkr4" pod "a8aeb621-0ec1-4163-b78e-486181a71715" (UID: "a8aeb621-0ec1-4163-b78e-486181a71715"). InnerVolumeSpecName "kube-api-access-jxkr4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:09:54.242392 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.242306 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxkr4\" (UniqueName: \"kubernetes.io/projected/a8aeb621-0ec1-4163-b78e-486181a71715-kube-api-access-jxkr4\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:54.242392 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.242338 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:54.242392 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.242352 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a8aeb621-0ec1-4163-b78e-486181a71715-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:09:54.970586 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.970553 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" Nov 03 20:09:54.970767 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.970547 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5" event={"ID":"a8aeb621-0ec1-4163-b78e-486181a71715","Type":"ContainerDied","Data":"9496cae38e672aec14d929f8871b21ba936f73cc275240ddf5f2bd87c67c3d71"} Nov 03 20:09:54.970767 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:54.970718 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9496cae38e672aec14d929f8871b21ba936f73cc275240ddf5f2bd87c67c3d71" Nov 03 20:09:55.637828 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:09:55.637797 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:00.522216 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.522184 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:00.796113 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.796039 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc"] Nov 03 20:10:00.796753 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.796736 5024 cpu_manager.go:414] "containerMap: removing container" podUID="a8aeb621-0ec1-4163-b78e-486181a71715" containerName="revoke-keys" Nov 03 20:10:00.796808 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.796756 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8aeb621-0ec1-4163-b78e-486181a71715" containerName="revoke-keys" Nov 03 20:10:00.796948 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.796936 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8aeb621-0ec1-4163-b78e-486181a71715" containerName="revoke-keys" Nov 03 20:10:00.800651 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.800633 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:00.857380 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.857346 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc"] Nov 03 20:10:00.902383 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.902349 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:10:00.902383 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.902349 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:10:00.908907 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.908875 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:00.909077 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.908951 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:00.909145 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:00.909107 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2tw9\" (UniqueName: \"kubernetes.io/projected/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-kube-api-access-n2tw9\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.009829 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.009799 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.010018 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.009841 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.010018 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.009874 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2tw9\" (UniqueName: \"kubernetes.io/projected/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-kube-api-access-n2tw9\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.010477 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.010455 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.012300 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.012278 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.070900 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.070825 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2tw9\" (UniqueName: \"kubernetes.io/projected/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-kube-api-access-n2tw9\") pod \"maas-api-revoke-sub-ed5585c5-fc4dc\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.114611 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.114583 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:01.498299 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:10:01.498266 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9709dfa0_3b96_4bc5_85b4_a62133d95e9d.slice/crio-22c967e21dbcc5f521edce1248c95c905effd3c41fa3c28e0e8a388e105b423f WatchSource:0}: Error finding container 22c967e21dbcc5f521edce1248c95c905effd3c41fa3c28e0e8a388e105b423f: Status 404 returned error can't find the container with id 22c967e21dbcc5f521edce1248c95c905effd3c41fa3c28e0e8a388e105b423f Nov 03 20:10:01.498446 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:01.498335 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc"] Nov 03 20:10:02.023258 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:02.023177 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" event={"ID":"9709dfa0-3b96-4bc5-85b4-a62133d95e9d","Type":"ContainerStarted","Data":"ca683792134fecddd51d5b0592cb0d01c8dd9a63968d81a2f9560b3cbadca585"} Nov 03 20:10:02.023258 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:02.023248 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" event={"ID":"9709dfa0-3b96-4bc5-85b4-a62133d95e9d","Type":"ContainerStarted","Data":"22c967e21dbcc5f521edce1248c95c905effd3c41fa3c28e0e8a388e105b423f"} Nov 03 20:10:02.048379 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:02.048347 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7"] Nov 03 20:10:02.051171 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:02.051150 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-70d0730a-872w7"] Nov 03 20:10:02.157341 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:02.157291 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" podStartSLOduration=2.157277564 podStartE2EDuration="2.157277564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:10:02.156669688 +0000 UTC m=+1149.938386356" watchObservedRunningTime="2026-11-03 20:10:02.157277564 +0000 UTC m=+1149.938994228" Nov 03 20:10:02.335866 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:02.335837 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ff3c22e-1c3f-4951-ace1-c8fff359160d" path="/var/lib/kubelet/pods/2ff3c22e-1c3f-4951-ace1-c8fff359160d/volumes" Nov 03 20:10:03.030702 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:03.030674 5024 generic.go:356] "Generic (PLEG): container finished" podID="9709dfa0-3b96-4bc5-85b4-a62133d95e9d" containerID="ca683792134fecddd51d5b0592cb0d01c8dd9a63968d81a2f9560b3cbadca585" exitCode=0 Nov 03 20:10:03.031101 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:03.030717 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" event={"ID":"9709dfa0-3b96-4bc5-85b4-a62133d95e9d","Type":"ContainerDied","Data":"ca683792134fecddd51d5b0592cb0d01c8dd9a63968d81a2f9560b3cbadca585"} Nov 03 20:10:04.213711 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.213685 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:04.252185 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.252153 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-openshift-ca\") pod \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " Nov 03 20:10:04.252326 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.252214 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-kube-api-access-n2tw9\" (UniqueName: \"kubernetes.io/projected/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-kube-api-access-n2tw9\") pod \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " Nov 03 20:10:04.252326 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.252262 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-xks-ca\") pod \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\" (UID: \"9709dfa0-3b96-4bc5-85b4-a62133d95e9d\") " Nov 03 20:10:04.252531 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.252509 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-openshift-ca" pod "9709dfa0-3b96-4bc5-85b4-a62133d95e9d" (UID: "9709dfa0-3b96-4bc5-85b4-a62133d95e9d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:10:04.252671 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.252641 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:04.255154 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.255131 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-xks-ca" pod "9709dfa0-3b96-4bc5-85b4-a62133d95e9d" (UID: "9709dfa0-3b96-4bc5-85b4-a62133d95e9d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:10:04.265712 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.265689 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-kube-api-access-n2tw9" pod "9709dfa0-3b96-4bc5-85b4-a62133d95e9d" (UID: "9709dfa0-3b96-4bc5-85b4-a62133d95e9d"). InnerVolumeSpecName "kube-api-access-n2tw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:10:04.353803 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.353727 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2tw9\" (UniqueName: \"kubernetes.io/projected/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-kube-api-access-n2tw9\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:04.354031 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:04.354011 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9709dfa0-3b96-4bc5-85b4-a62133d95e9d-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:10:05.051324 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:05.051285 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" event={"ID":"9709dfa0-3b96-4bc5-85b4-a62133d95e9d","Type":"ContainerDied","Data":"22c967e21dbcc5f521edce1248c95c905effd3c41fa3c28e0e8a388e105b423f"} Nov 03 20:10:05.051536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:05.051346 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="22c967e21dbcc5f521edce1248c95c905effd3c41fa3c28e0e8a388e105b423f" Nov 03 20:10:05.051536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:05.051373 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc" Nov 03 20:10:05.475833 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:05.475789 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:06.605965 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:06.603069 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:06.605965 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:06.603141 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:06.632068 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:06.632031 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:06.632333 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:06.632305 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:07.665311 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:10:07.665235 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:10:10.436301 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:10.436265 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:13.051052 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:13.051019 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8"] Nov 03 20:10:13.100166 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:13.100137 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4ed8392b-vwnq8"] Nov 03 20:10:14.336169 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:14.336132 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa511e40-b9b6-4b7d-b341-5c813b009620" path="/var/lib/kubelet/pods/fa511e40-b9b6-4b7d-b341-5c813b009620/volumes" Nov 03 20:10:15.288843 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:15.288809 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:15.472842 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:15.472809 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:20.419711 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:20.419676 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:22.000898 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:22.000859 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:25.534402 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:25.534365 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:28.200080 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:28.200033 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-q6cx2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:28.200701 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:28.200653 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-q6cx2" podUID="f6f75017-0a57-4f8c-b105-c8434fc35780" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:30.518612 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:30.518580 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:35.323327 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:35.323299 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:37.571529 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:10:37.571495 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:10:40.321798 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:40.321726 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:43.048596 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:43.048562 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:45.223355 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:45.223322 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:46.909815 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:46.909730 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:48.285200 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:48.285164 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:50.342054 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:50.342019 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:10:50.686560 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:50.686039 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-xj5qx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:50.686560 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:50.686126 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-xj5qx" podUID="40cca8d5-0ecc-48f9-a56b-d46cd2359f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:51.616159 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:51.616085 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:51.616836 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:51.616803 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:51.636173 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:51.636125 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:10:51.636462 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:51.636418 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:10:52.510766 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:52.510736 5024 scope.go:122] "RemoveContainer" containerID="f86c9ffeafb2e8375671e90499341529e01c2d60aac6bc58d625ed167ae492c3" Nov 03 20:10:52.521460 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:52.521434 5024 scope.go:122] "RemoveContainer" containerID="3eb5d1e266dc9f3720fb51905adc73a369d5cfd619f29a931fc8c7518e104679" Nov 03 20:10:52.531033 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:52.531008 5024 scope.go:122] "RemoveContainer" containerID="af530b2e945b040222f0dc667d5e0fd59f500a3438622a1dde77344ba80c2aa8" Nov 03 20:10:52.654819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:52.654778 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 20:10:52.658660 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:52.658638 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-7bmz4_c76f66cb-43f9-4ce9-8ce4-04f241205199/console-operator/2.log" Nov 03 20:10:52.660598 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:52.660578 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 20:10:52.662658 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:52.662637 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xgbcv_1687e9c0-54ea-45aa-accd-ebfcf8cc9efa/ovn-acl-logging/0.log" Nov 03 20:10:55.490953 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:10:55.490807 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:00.419664 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:00.419631 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:05.310338 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:05.310252 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:07.269652 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:07.269598 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:07.574290 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:11:07.574203 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:11:10.246650 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:10.246612 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:15.116315 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:15.116275 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:20.013146 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:20.013112 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:20.569018 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:20.568976 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:20.748854 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:20.748816 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:24.040414 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:24.040379 5024 generic.go:356] "Generic (PLEG): container finished" podID="cf7fda61-28fe-4e0d-b554-2046aac2f8ee" containerID="012dfdad4412c735282273372968af8ca22856caaf9fe425449c90b568186932" exitCode=0 Nov 03 20:11:24.040845 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:24.040453 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" event={"ID":"cf7fda61-28fe-4e0d-b554-2046aac2f8ee","Type":"ContainerDied","Data":"012dfdad4412c735282273372968af8ca22856caaf9fe425449c90b568186932"} Nov 03 20:11:24.934980 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:24.934918 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:25.198796 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.198730 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:11:25.268904 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.268846 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-kube-api-access-rc75k\" (UniqueName: \"kubernetes.io/projected/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-kube-api-access-rc75k\") pod \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " Nov 03 20:11:25.269137 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.268915 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-service-ca-bundle\") pod \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " Nov 03 20:11:25.269137 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.268984 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-archives-path\") pod \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " Nov 03 20:11:25.269137 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.269095 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-trusted-ca-bundle\") pod \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\" (UID: \"cf7fda61-28fe-4e0d-b554-2046aac2f8ee\") " Nov 03 20:11:25.269314 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.269268 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-service-ca-bundle" pod "cf7fda61-28fe-4e0d-b554-2046aac2f8ee" (UID: "cf7fda61-28fe-4e0d-b554-2046aac2f8ee"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:11:25.269371 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.269352 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-archives-path" pod "cf7fda61-28fe-4e0d-b554-2046aac2f8ee" (UID: "cf7fda61-28fe-4e0d-b554-2046aac2f8ee"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:11:25.269469 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.269448 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-trusted-ca-bundle" pod "cf7fda61-28fe-4e0d-b554-2046aac2f8ee" (UID: "cf7fda61-28fe-4e0d-b554-2046aac2f8ee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:11:25.269511 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.269475 5024 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-service-ca-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:11:25.269511 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.269493 5024 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-archives-path\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:11:25.271195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.271174 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-kube-api-access-rc75k" pod "cf7fda61-28fe-4e0d-b554-2046aac2f8ee" (UID: "cf7fda61-28fe-4e0d-b554-2046aac2f8ee"). InnerVolumeSpecName "kube-api-access-rc75k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:11:25.370943 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.370901 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc75k\" (UniqueName: \"kubernetes.io/projected/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-kube-api-access-rc75k\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:11:25.370943 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:25.370952 5024 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf7fda61-28fe-4e0d-b554-2046aac2f8ee-trusted-ca-bundle\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:11:26.054260 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:26.054236 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" Nov 03 20:11:26.054439 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:26.054277 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-rz4p4-rb7lq" event={"ID":"cf7fda61-28fe-4e0d-b554-2046aac2f8ee","Type":"ContainerDied","Data":"6e33dcc3f5f2a3ebfde9418e467e296aceddab2cee03877df02f99a3c50bb53b"} Nov 03 20:11:26.054439 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:26.054317 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e33dcc3f5f2a3ebfde9418e467e296aceddab2cee03877df02f99a3c50bb53b" Nov 03 20:11:27.359602 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:27.359558 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:27.539705 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:27.539673 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:29.821576 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:29.821543 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:34.712112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:34.712067 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:37.573491 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:11:37.573453 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:11:37.807970 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:37.807918 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:39.732265 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:39.732231 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:44.642704 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:44.642620 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:48.694071 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:48.694024 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:49.539083 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:49.537263 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:52.570106 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:52.570069 5024 scope.go:122] "RemoveContainer" containerID="095d1e710355a49b8cd18f4ff6a4751418e2515d3012da721c83c1a22b57a8f2" Nov 03 20:11:52.580433 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:52.580414 5024 scope.go:122] "RemoveContainer" containerID="3dbe6282a3c8cbd070b0ccea940ab290dcdc9d469672f7a42c90067ae03e17aa" Nov 03 20:11:54.442685 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:54.442651 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:56.755905 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.755868 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt"] Nov 03 20:11:56.756354 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.756341 5024 cpu_manager.go:414] "containerMap: removing container" podUID="9709dfa0-3b96-4bc5-85b4-a62133d95e9d" containerName="revoke-keys" Nov 03 20:11:56.756402 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.756355 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9709dfa0-3b96-4bc5-85b4-a62133d95e9d" containerName="revoke-keys" Nov 03 20:11:56.756402 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.756388 5024 cpu_manager.go:414] "containerMap: removing container" podUID="cf7fda61-28fe-4e0d-b554-2046aac2f8ee" containerName="insights-gathering" Nov 03 20:11:56.756402 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.756392 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf7fda61-28fe-4e0d-b554-2046aac2f8ee" containerName="insights-gathering" Nov 03 20:11:56.756494 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.756474 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="9709dfa0-3b96-4bc5-85b4-a62133d95e9d" containerName="revoke-keys" Nov 03 20:11:56.756494 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.756486 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf7fda61-28fe-4e0d-b554-2046aac2f8ee" containerName="insights-gathering" Nov 03 20:11:56.761276 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.761258 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:56.817593 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.817564 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt"] Nov 03 20:11:56.863370 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.863340 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:11:56.863545 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.863457 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:11:56.896502 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.896460 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:56.896688 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.896519 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:56.896734 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.896685 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldzvl\" (UniqueName: \"kubernetes.io/projected/8daacab3-9449-4329-b684-b6b747bf4750-kube-api-access-ldzvl\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:56.998258 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.998219 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:56.998458 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.998283 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:56.998458 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.998363 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldzvl\" (UniqueName: \"kubernetes.io/projected/8daacab3-9449-4329-b684-b6b747bf4750-kube-api-access-ldzvl\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:56.999092 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:56.999073 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:57.000982 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:57.000963 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:57.059500 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:57.059422 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldzvl\" (UniqueName: \"kubernetes.io/projected/8daacab3-9449-4329-b684-b6b747bf4750-kube-api-access-ldzvl\") pod \"maas-api-revoke-sub-9abbcc44-j76xt\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:57.074346 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:57.074316 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:57.451105 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:57.451075 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt"] Nov 03 20:11:57.452731 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:11:57.452703 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8daacab3_9449_4329_b684_b6b747bf4750.slice/crio-45d484c92ee269cc33eb930215fb7322525151f3f0a6a5327a60d24021332b35 WatchSource:0}: Error finding container 45d484c92ee269cc33eb930215fb7322525151f3f0a6a5327a60d24021332b35: Status 404 returned error can't find the container with id 45d484c92ee269cc33eb930215fb7322525151f3f0a6a5327a60d24021332b35 Nov 03 20:11:58.279388 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:58.279347 5024 generic.go:356] "Generic (PLEG): container finished" podID="8daacab3-9449-4329-b684-b6b747bf4750" containerID="69276d10b43517daebd460f4c2bfca7f9abc3468f87496df12f5c9da6d7573f4" exitCode=0 Nov 03 20:11:58.279786 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:58.279388 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" event={"ID":"8daacab3-9449-4329-b684-b6b747bf4750","Type":"ContainerDied","Data":"69276d10b43517daebd460f4c2bfca7f9abc3468f87496df12f5c9da6d7573f4"} Nov 03 20:11:58.279786 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:58.279480 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" event={"ID":"8daacab3-9449-4329-b684-b6b747bf4750","Type":"ContainerStarted","Data":"45d484c92ee269cc33eb930215fb7322525151f3f0a6a5327a60d24021332b35"} Nov 03 20:11:59.435307 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.435271 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:11:59.440166 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.440136 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:11:59.522861 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.522829 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-openshift-ca\") pod \"8daacab3-9449-4329-b684-b6b747bf4750\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " Nov 03 20:11:59.523091 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.522883 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-xks-ca\") pod \"8daacab3-9449-4329-b684-b6b747bf4750\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " Nov 03 20:11:59.523091 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.522919 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8daacab3-9449-4329-b684-b6b747bf4750-kube-api-access-ldzvl\" (UniqueName: \"kubernetes.io/projected/8daacab3-9449-4329-b684-b6b747bf4750-kube-api-access-ldzvl\") pod \"8daacab3-9449-4329-b684-b6b747bf4750\" (UID: \"8daacab3-9449-4329-b684-b6b747bf4750\") " Nov 03 20:11:59.523240 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.523214 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-openshift-ca" pod "8daacab3-9449-4329-b684-b6b747bf4750" (UID: "8daacab3-9449-4329-b684-b6b747bf4750"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:11:59.525124 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.525095 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-xks-ca" pod "8daacab3-9449-4329-b684-b6b747bf4750" (UID: "8daacab3-9449-4329-b684-b6b747bf4750"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:11:59.525229 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.525178 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8daacab3-9449-4329-b684-b6b747bf4750-kube-api-access-ldzvl" pod "8daacab3-9449-4329-b684-b6b747bf4750" (UID: "8daacab3-9449-4329-b684-b6b747bf4750"). InnerVolumeSpecName "kube-api-access-ldzvl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:11:59.623727 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.623642 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:11:59.623727 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.623672 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8daacab3-9449-4329-b684-b6b747bf4750-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:11:59.623727 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:11:59.623682 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldzvl\" (UniqueName: \"kubernetes.io/projected/8daacab3-9449-4329-b684-b6b747bf4750-kube-api-access-ldzvl\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:00.293405 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:00.293376 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" Nov 03 20:12:00.293588 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:00.293373 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9abbcc44-j76xt" event={"ID":"8daacab3-9449-4329-b684-b6b747bf4750","Type":"ContainerDied","Data":"45d484c92ee269cc33eb930215fb7322525151f3f0a6a5327a60d24021332b35"} Nov 03 20:12:00.293588 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:00.293503 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45d484c92ee269cc33eb930215fb7322525151f3f0a6a5327a60d24021332b35" Nov 03 20:12:04.326350 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:04.326317 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:07.572392 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:12:07.572355 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:12:07.797847 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.797815 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl"] Nov 03 20:12:07.798304 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.798288 5024 cpu_manager.go:414] "containerMap: removing container" podUID="8daacab3-9449-4329-b684-b6b747bf4750" containerName="revoke-keys" Nov 03 20:12:07.798304 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.798302 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8daacab3-9449-4329-b684-b6b747bf4750" containerName="revoke-keys" Nov 03 20:12:07.798453 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.798407 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="8daacab3-9449-4329-b684-b6b747bf4750" containerName="revoke-keys" Nov 03 20:12:07.801755 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.801731 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:07.860765 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.860695 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl"] Nov 03 20:12:07.905477 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.905451 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:12:07.905632 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.905512 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:12:07.909959 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.909911 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:07.910087 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.909978 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:07.910155 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:07.910133 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c97tp\" (UniqueName: \"kubernetes.io/projected/12771b68-6e97-496e-8d24-7428cf9f4161-kube-api-access-c97tp\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.011405 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.011353 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.011405 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.011409 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.011699 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.011460 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c97tp\" (UniqueName: \"kubernetes.io/projected/12771b68-6e97-496e-8d24-7428cf9f4161-kube-api-access-c97tp\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.012121 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.012096 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.014074 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.014055 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.073125 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.073097 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c97tp\" (UniqueName: \"kubernetes.io/projected/12771b68-6e97-496e-8d24-7428cf9f4161-kube-api-access-c97tp\") pod \"maas-api-revoke-sub-ef4fc6f6-b9cxl\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.118209 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.118123 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:08.497043 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:08.497012 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl"] Nov 03 20:12:08.497678 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:12:08.497646 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12771b68_6e97_496e_8d24_7428cf9f4161.slice/crio-7a5072116f20e3a9a6f57683936737cbea755833840d91a7c69bd13a46161f7e WatchSource:0}: Error finding container 7a5072116f20e3a9a6f57683936737cbea755833840d91a7c69bd13a46161f7e: Status 404 returned error can't find the container with id 7a5072116f20e3a9a6f57683936737cbea755833840d91a7c69bd13a46161f7e Nov 03 20:12:09.239004 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:09.238326 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:09.355564 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:09.355529 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" event={"ID":"12771b68-6e97-496e-8d24-7428cf9f4161","Type":"ContainerStarted","Data":"0183dd960f8d04ec315d700ab5fb47f796205b5a8ab13d40b16e4c8502d68aad"} Nov 03 20:12:09.355717 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:09.355589 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" event={"ID":"12771b68-6e97-496e-8d24-7428cf9f4161","Type":"ContainerStarted","Data":"7a5072116f20e3a9a6f57683936737cbea755833840d91a7c69bd13a46161f7e"} Nov 03 20:12:09.474558 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:09.474506 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" podStartSLOduration=2.474492736 podStartE2EDuration="2.474492736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:12:09.47110265 +0000 UTC m=+1277.252819317" watchObservedRunningTime="2026-11-03 20:12:09.474492736 +0000 UTC m=+1277.256209458" Nov 03 20:12:10.363147 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:10.363109 5024 generic.go:356] "Generic (PLEG): container finished" podID="12771b68-6e97-496e-8d24-7428cf9f4161" containerID="0183dd960f8d04ec315d700ab5fb47f796205b5a8ab13d40b16e4c8502d68aad" exitCode=0 Nov 03 20:12:10.363554 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:10.363196 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" event={"ID":"12771b68-6e97-496e-8d24-7428cf9f4161","Type":"ContainerDied","Data":"0183dd960f8d04ec315d700ab5fb47f796205b5a8ab13d40b16e4c8502d68aad"} Nov 03 20:12:11.520813 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.520789 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:11.649656 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.649628 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12771b68-6e97-496e-8d24-7428cf9f4161-kube-api-access-c97tp\" (UniqueName: \"kubernetes.io/projected/12771b68-6e97-496e-8d24-7428cf9f4161-kube-api-access-c97tp\") pod \"12771b68-6e97-496e-8d24-7428cf9f4161\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " Nov 03 20:12:11.649838 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.649674 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-xks-ca\") pod \"12771b68-6e97-496e-8d24-7428cf9f4161\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " Nov 03 20:12:11.649904 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.649855 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-openshift-ca\") pod \"12771b68-6e97-496e-8d24-7428cf9f4161\" (UID: \"12771b68-6e97-496e-8d24-7428cf9f4161\") " Nov 03 20:12:11.650214 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.650184 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-openshift-ca" pod "12771b68-6e97-496e-8d24-7428cf9f4161" (UID: "12771b68-6e97-496e-8d24-7428cf9f4161"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:12:11.652093 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.652065 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12771b68-6e97-496e-8d24-7428cf9f4161-kube-api-access-c97tp" pod "12771b68-6e97-496e-8d24-7428cf9f4161" (UID: "12771b68-6e97-496e-8d24-7428cf9f4161"). InnerVolumeSpecName "kube-api-access-c97tp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:12:11.652495 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.652470 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-xks-ca" pod "12771b68-6e97-496e-8d24-7428cf9f4161" (UID: "12771b68-6e97-496e-8d24-7428cf9f4161"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:12:11.751722 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.751688 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:11.751722 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.751718 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c97tp\" (UniqueName: \"kubernetes.io/projected/12771b68-6e97-496e-8d24-7428cf9f4161-kube-api-access-c97tp\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:11.751722 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:11.751727 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/12771b68-6e97-496e-8d24-7428cf9f4161-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:12.380226 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:12.380194 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" Nov 03 20:12:12.380386 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:12.380231 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ef4fc6f6-b9cxl" event={"ID":"12771b68-6e97-496e-8d24-7428cf9f4161","Type":"ContainerDied","Data":"7a5072116f20e3a9a6f57683936737cbea755833840d91a7c69bd13a46161f7e"} Nov 03 20:12:12.380386 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:12.380288 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a5072116f20e3a9a6f57683936737cbea755833840d91a7c69bd13a46161f7e" Nov 03 20:12:14.175630 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:14.175514 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:18.451511 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.451479 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm"] Nov 03 20:12:18.451990 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.451976 5024 cpu_manager.go:414] "containerMap: removing container" podUID="12771b68-6e97-496e-8d24-7428cf9f4161" containerName="revoke-keys" Nov 03 20:12:18.452040 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.451991 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12771b68-6e97-496e-8d24-7428cf9f4161" containerName="revoke-keys" Nov 03 20:12:18.452103 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.452094 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="12771b68-6e97-496e-8d24-7428cf9f4161" containerName="revoke-keys" Nov 03 20:12:18.455307 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.455288 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.513134 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.513102 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm"] Nov 03 20:12:18.557961 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.557905 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:12:18.558120 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.558027 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:12:18.632671 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.632634 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzb5\" (UniqueName: \"kubernetes.io/projected/7e42d136-f417-4552-b53f-269d0eb52c59-kube-api-access-jfzb5\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.632850 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.632699 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.632850 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.632796 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.733752 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.733651 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.733752 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.733705 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.734024 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.733823 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzb5\" (UniqueName: \"kubernetes.io/projected/7e42d136-f417-4552-b53f-269d0eb52c59-kube-api-access-jfzb5\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.734334 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.734314 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.736504 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.736478 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:18.794687 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:18.794663 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzb5\" (UniqueName: \"kubernetes.io/projected/7e42d136-f417-4552-b53f-269d0eb52c59-kube-api-access-jfzb5\") pod \"maas-api-revoke-sub-cf6baee9-khsrm\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:19.068744 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:19.068658 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:19.231627 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:19.231589 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:19.469690 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:19.469652 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm"] Nov 03 20:12:19.480663 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:12:19.480624 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e42d136_f417_4552_b53f_269d0eb52c59.slice/crio-15cf91ae41ec22c259ea2624b0442a5dea27a2c4f52fa3ad0dc83487a87ae4aa WatchSource:0}: Error finding container 15cf91ae41ec22c259ea2624b0442a5dea27a2c4f52fa3ad0dc83487a87ae4aa: Status 404 returned error can't find the container with id 15cf91ae41ec22c259ea2624b0442a5dea27a2c4f52fa3ad0dc83487a87ae4aa Nov 03 20:12:19.530461 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:19.530422 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" event={"ID":"7e42d136-f417-4552-b53f-269d0eb52c59","Type":"ContainerStarted","Data":"15cf91ae41ec22c259ea2624b0442a5dea27a2c4f52fa3ad0dc83487a87ae4aa"} Nov 03 20:12:20.575976 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:20.575251 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" event={"ID":"7e42d136-f417-4552-b53f-269d0eb52c59","Type":"ContainerStarted","Data":"853f980dfb439eca9c2faba491c6b8338baa60fea2505691c53890bff14a94e6"} Nov 03 20:12:20.705861 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:20.705800 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" podStartSLOduration=2.705778402 podStartE2EDuration="2.705778402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:12:20.702344247 +0000 UTC m=+1288.484060915" watchObservedRunningTime="2026-11-03 20:12:20.705778402 +0000 UTC m=+1288.487495070" Nov 03 20:12:21.602146 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:21.602093 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-gvnng container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:12:21.602817 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:21.602765 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-gvnng" podUID="83837dc2-b70c-4109-9327-6bdfb43a9d71" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:12:21.619037 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:21.618999 5024 generic.go:356] "Generic (PLEG): container finished" podID="7e42d136-f417-4552-b53f-269d0eb52c59" containerID="853f980dfb439eca9c2faba491c6b8338baa60fea2505691c53890bff14a94e6" exitCode=0 Nov 03 20:12:21.619816 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:21.619607 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" event={"ID":"7e42d136-f417-4552-b53f-269d0eb52c59","Type":"ContainerDied","Data":"853f980dfb439eca9c2faba491c6b8338baa60fea2505691c53890bff14a94e6"} Nov 03 20:12:21.646953 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:21.646059 5024 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-59f957fdd7-n79ks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 03 20:12:21.646953 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:21.646145 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-59f957fdd7-n79ks" podUID="dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 03 20:12:23.313851 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.313825 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:23.381009 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.380898 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-openshift-ca\") pod \"7e42d136-f417-4552-b53f-269d0eb52c59\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " Nov 03 20:12:23.381187 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.381021 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-xks-ca\") pod \"7e42d136-f417-4552-b53f-269d0eb52c59\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " Nov 03 20:12:23.381187 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.381115 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e42d136-f417-4552-b53f-269d0eb52c59-kube-api-access-jfzb5\" (UniqueName: \"kubernetes.io/projected/7e42d136-f417-4552-b53f-269d0eb52c59-kube-api-access-jfzb5\") pod \"7e42d136-f417-4552-b53f-269d0eb52c59\" (UID: \"7e42d136-f417-4552-b53f-269d0eb52c59\") " Nov 03 20:12:23.381310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.381281 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-openshift-ca" pod "7e42d136-f417-4552-b53f-269d0eb52c59" (UID: "7e42d136-f417-4552-b53f-269d0eb52c59"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:12:23.381570 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.381538 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:23.384060 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.384028 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-xks-ca" pod "7e42d136-f417-4552-b53f-269d0eb52c59" (UID: "7e42d136-f417-4552-b53f-269d0eb52c59"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:12:23.384195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.384086 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e42d136-f417-4552-b53f-269d0eb52c59-kube-api-access-jfzb5" pod "7e42d136-f417-4552-b53f-269d0eb52c59" (UID: "7e42d136-f417-4552-b53f-269d0eb52c59"). InnerVolumeSpecName "kube-api-access-jfzb5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:12:23.482689 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.482657 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e42d136-f417-4552-b53f-269d0eb52c59-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:23.482689 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.482686 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfzb5\" (UniqueName: \"kubernetes.io/projected/7e42d136-f417-4552-b53f-269d0eb52c59-kube-api-access-jfzb5\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:23.655757 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.655728 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" Nov 03 20:12:23.655963 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.655770 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf6baee9-khsrm" event={"ID":"7e42d136-f417-4552-b53f-269d0eb52c59","Type":"ContainerDied","Data":"15cf91ae41ec22c259ea2624b0442a5dea27a2c4f52fa3ad0dc83487a87ae4aa"} Nov 03 20:12:23.655963 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:23.655827 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15cf91ae41ec22c259ea2624b0442a5dea27a2c4f52fa3ad0dc83487a87ae4aa" Nov 03 20:12:24.214857 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:24.214805 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:29.216718 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.216679 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr"] Nov 03 20:12:29.218247 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.218220 5024 cpu_manager.go:414] "containerMap: removing container" podUID="7e42d136-f417-4552-b53f-269d0eb52c59" containerName="revoke-keys" Nov 03 20:12:29.218422 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.218407 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e42d136-f417-4552-b53f-269d0eb52c59" containerName="revoke-keys" Nov 03 20:12:29.218702 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.218686 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e42d136-f417-4552-b53f-269d0eb52c59" containerName="revoke-keys" Nov 03 20:12:29.239813 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.239776 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.314960 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.306542 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr"] Nov 03 20:12:29.371057 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.370286 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:12:29.371057 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.371020 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:12:29.372261 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.372236 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.375157 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.375132 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.375481 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.375459 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf9rj\" (UniqueName: \"kubernetes.io/projected/40a72a6d-a767-4bf2-be13-11b02b87e5f0-kube-api-access-wf9rj\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.389591 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.389531 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:29.484000 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.483183 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf9rj\" (UniqueName: \"kubernetes.io/projected/40a72a6d-a767-4bf2-be13-11b02b87e5f0-kube-api-access-wf9rj\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.484000 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.483260 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.484000 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.483361 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.505970 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.492690 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.541954 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.539408 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-xks-ca\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.550951 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.549790 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf9rj\" (UniqueName: \"kubernetes.io/projected/40a72a6d-a767-4bf2-be13-11b02b87e5f0-kube-api-access-wf9rj\") pod \"maas-api-revoke-sub-6d4b62e3-sn2jr\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:29.593956 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:29.591119 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:30.202865 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:30.202836 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr"] Nov 03 20:12:30.204036 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:12:30.204010 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a72a6d_a767_4bf2_be13_11b02b87e5f0.slice/crio-11e2c115081c7e5c6295fa3be7a4ef0a73c1442a7e45d83362a98e2e263a8510 WatchSource:0}: Error finding container 11e2c115081c7e5c6295fa3be7a4ef0a73c1442a7e45d83362a98e2e263a8510: Status 404 returned error can't find the container with id 11e2c115081c7e5c6295fa3be7a4ef0a73c1442a7e45d83362a98e2e263a8510 Nov 03 20:12:30.776737 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:30.776650 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" event={"ID":"40a72a6d-a767-4bf2-be13-11b02b87e5f0","Type":"ContainerStarted","Data":"27a3409679205ee9688b13e9addfaed38bc073f1820573de3db975ccc1e887a2"} Nov 03 20:12:30.776737 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:30.776700 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" event={"ID":"40a72a6d-a767-4bf2-be13-11b02b87e5f0","Type":"ContainerStarted","Data":"11e2c115081c7e5c6295fa3be7a4ef0a73c1442a7e45d83362a98e2e263a8510"} Nov 03 20:12:30.898267 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:30.898200 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" podStartSLOduration=1.898183461 podStartE2EDuration="1.898183461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:12:30.894673922 +0000 UTC m=+1298.676390607" watchObservedRunningTime="2026-11-03 20:12:30.898183461 +0000 UTC m=+1298.679900159" Nov 03 20:12:31.784894 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:31.784856 5024 generic.go:356] "Generic (PLEG): container finished" podID="40a72a6d-a767-4bf2-be13-11b02b87e5f0" containerID="27a3409679205ee9688b13e9addfaed38bc073f1820573de3db975ccc1e887a2" exitCode=0 Nov 03 20:12:31.785334 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:31.784904 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" event={"ID":"40a72a6d-a767-4bf2-be13-11b02b87e5f0","Type":"ContainerDied","Data":"27a3409679205ee9688b13e9addfaed38bc073f1820573de3db975ccc1e887a2"} Nov 03 20:12:32.947386 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:32.947362 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:33.035907 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.035876 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40a72a6d-a767-4bf2-be13-11b02b87e5f0-kube-api-access-wf9rj\" (UniqueName: \"kubernetes.io/projected/40a72a6d-a767-4bf2-be13-11b02b87e5f0-kube-api-access-wf9rj\") pod \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " Nov 03 20:12:33.036094 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.035919 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-xks-ca\") pod \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " Nov 03 20:12:33.036094 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.035981 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-openshift-ca\") pod \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\" (UID: \"40a72a6d-a767-4bf2-be13-11b02b87e5f0\") " Nov 03 20:12:33.036356 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.036327 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-openshift-ca" pod "40a72a6d-a767-4bf2-be13-11b02b87e5f0" (UID: "40a72a6d-a767-4bf2-be13-11b02b87e5f0"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:12:33.038254 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.038228 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-xks-ca" pod "40a72a6d-a767-4bf2-be13-11b02b87e5f0" (UID: "40a72a6d-a767-4bf2-be13-11b02b87e5f0"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:12:33.038362 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.038311 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40a72a6d-a767-4bf2-be13-11b02b87e5f0-kube-api-access-wf9rj" pod "40a72a6d-a767-4bf2-be13-11b02b87e5f0" (UID: "40a72a6d-a767-4bf2-be13-11b02b87e5f0"). InnerVolumeSpecName "kube-api-access-wf9rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:12:33.137617 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.137595 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf9rj\" (UniqueName: \"kubernetes.io/projected/40a72a6d-a767-4bf2-be13-11b02b87e5f0-kube-api-access-wf9rj\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:33.137758 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.137621 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:33.137758 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.137631 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/40a72a6d-a767-4bf2-be13-11b02b87e5f0-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:33.806472 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.806442 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" Nov 03 20:12:33.806650 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.806467 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-6d4b62e3-sn2jr" event={"ID":"40a72a6d-a767-4bf2-be13-11b02b87e5f0","Type":"ContainerDied","Data":"11e2c115081c7e5c6295fa3be7a4ef0a73c1442a7e45d83362a98e2e263a8510"} Nov 03 20:12:33.806650 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:33.806520 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11e2c115081c7e5c6295fa3be7a4ef0a73c1442a7e45d83362a98e2e263a8510" Nov 03 20:12:34.232407 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:34.232315 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:37.573377 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:12:37.573343 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:12:39.154219 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:39.154182 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:39.921753 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:39.921721 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl"] Nov 03 20:12:39.922252 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:39.922238 5024 cpu_manager.go:414] "containerMap: removing container" podUID="40a72a6d-a767-4bf2-be13-11b02b87e5f0" containerName="revoke-keys" Nov 03 20:12:39.922306 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:39.922254 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40a72a6d-a767-4bf2-be13-11b02b87e5f0" containerName="revoke-keys" Nov 03 20:12:39.922339 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:39.922329 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="40a72a6d-a767-4bf2-be13-11b02b87e5f0" containerName="revoke-keys" Nov 03 20:12:39.925633 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:39.925616 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:39.979220 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:39.979179 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\"" Nov 03 20:12:40.006749 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.006709 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.006919 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.006766 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9clz\" (UniqueName: \"kubernetes.io/projected/53cfe0ad-25f6-44ec-8a8a-9236efb76973-kube-api-access-q9clz\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.006986 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.006947 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.028883 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.028854 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:12:40.032404 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.032384 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl"] Nov 03 20:12:40.108384 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.108342 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.108588 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.108390 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9clz\" (UniqueName: \"kubernetes.io/projected/53cfe0ad-25f6-44ec-8a8a-9236efb76973-kube-api-access-q9clz\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.108588 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.108501 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.109316 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.109286 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.111445 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.111422 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.169990 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.169956 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9clz\" (UniqueName: \"kubernetes.io/projected/53cfe0ad-25f6-44ec-8a8a-9236efb76973-kube-api-access-q9clz\") pod \"maas-api-revoke-sub-5c22c397-gx7jl\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.238856 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.238764 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:40.618170 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:12:40.618130 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53cfe0ad_25f6_44ec_8a8a_9236efb76973.slice/crio-e09f5d9fa8fc2861cf0021a56e237e71ca08ba63bfc17ad8c64d5957620d6998 WatchSource:0}: Error finding container e09f5d9fa8fc2861cf0021a56e237e71ca08ba63bfc17ad8c64d5957620d6998: Status 404 returned error can't find the container with id e09f5d9fa8fc2861cf0021a56e237e71ca08ba63bfc17ad8c64d5957620d6998 Nov 03 20:12:40.619310 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.619283 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl"] Nov 03 20:12:40.852872 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:40.852837 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" event={"ID":"53cfe0ad-25f6-44ec-8a8a-9236efb76973","Type":"ContainerStarted","Data":"e09f5d9fa8fc2861cf0021a56e237e71ca08ba63bfc17ad8c64d5957620d6998"} Nov 03 20:12:41.862535 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:41.862432 5024 generic.go:356] "Generic (PLEG): container finished" podID="53cfe0ad-25f6-44ec-8a8a-9236efb76973" containerID="1b740bc07b31b08f79fb3869bcec64c19a748ff7da4225b5e95b061804188e10" exitCode=0 Nov 03 20:12:41.862535 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:41.862498 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" event={"ID":"53cfe0ad-25f6-44ec-8a8a-9236efb76973","Type":"ContainerDied","Data":"1b740bc07b31b08f79fb3869bcec64c19a748ff7da4225b5e95b061804188e10"} Nov 03 20:12:43.016584 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.016557 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:43.140171 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.140142 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53cfe0ad-25f6-44ec-8a8a-9236efb76973-kube-api-access-q9clz\" (UniqueName: \"kubernetes.io/projected/53cfe0ad-25f6-44ec-8a8a-9236efb76973-kube-api-access-q9clz\") pod \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " Nov 03 20:12:43.140486 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.140466 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-openshift-ca\") pod \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " Nov 03 20:12:43.141509 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.141485 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-xks-ca\") pod \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\" (UID: \"53cfe0ad-25f6-44ec-8a8a-9236efb76973\") " Nov 03 20:12:43.142429 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.140854 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-openshift-ca" pod "53cfe0ad-25f6-44ec-8a8a-9236efb76973" (UID: "53cfe0ad-25f6-44ec-8a8a-9236efb76973"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:12:43.153974 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.153084 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53cfe0ad-25f6-44ec-8a8a-9236efb76973-kube-api-access-q9clz" pod "53cfe0ad-25f6-44ec-8a8a-9236efb76973" (UID: "53cfe0ad-25f6-44ec-8a8a-9236efb76973"). InnerVolumeSpecName "kube-api-access-q9clz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:12:43.154107 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.154017 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-xks-ca" pod "53cfe0ad-25f6-44ec-8a8a-9236efb76973" (UID: "53cfe0ad-25f6-44ec-8a8a-9236efb76973"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 03 20:12:43.243089 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.243055 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-openshift-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:43.243089 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.243086 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/53cfe0ad-25f6-44ec-8a8a-9236efb76973-maas-api-xks-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:43.243089 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.243094 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9clz\" (UniqueName: \"kubernetes.io/projected/53cfe0ad-25f6-44ec-8a8a-9236efb76973-kube-api-access-q9clz\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:12:43.881897 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.881866 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" Nov 03 20:12:43.882260 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.881891 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5c22c397-gx7jl" event={"ID":"53cfe0ad-25f6-44ec-8a8a-9236efb76973","Type":"ContainerDied","Data":"e09f5d9fa8fc2861cf0021a56e237e71ca08ba63bfc17ad8c64d5957620d6998"} Nov 03 20:12:43.882454 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:43.882428 5024 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e09f5d9fa8fc2861cf0021a56e237e71ca08ba63bfc17ad8c64d5957620d6998" Nov 03 20:12:44.049961 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:44.049910 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:48.989119 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:48.989086 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:49.171799 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:49.171766 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:54.022951 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:54.022676 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:54.430413 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:54.430372 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:12:59.178112 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:12:59.178076 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:01.199642 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:01.199593 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:04.256054 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:04.256008 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:07.696616 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:13:07.696536 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:13:09.257207 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:09.257174 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:14.221755 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:14.221716 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:19.120319 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:19.120287 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:24.031188 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:24.031150 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:28.932302 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:28.932256 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:31.887253 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:31.887203 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:33.821195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:33.821161 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:37.571589 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:13:37.571552 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:13:38.132487 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:38.132443 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:38.313265 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:38.313240 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:38.489163 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:38.489125 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494"] Nov 03 20:13:38.585151 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:38.585118 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l"] Nov 03 20:13:38.721778 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:38.721748 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:38.898375 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:38.898338 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:40.125980 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:40.125946 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:43.490082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:43.490039 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" podUID="0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" containerName="payload-processing" containerID="cri-o://de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f" gracePeriod=25 Nov 03 20:13:43.585966 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:43.585881 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" podUID="f6a109f2-f69b-4e70-a42e-b01349a1d5da" containerName="payload-pre-processing" containerID="cri-o://f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787" gracePeriod=25 Nov 03 20:13:43.841229 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:43.841200 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:13:43.859082 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:43.859056 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:43.874341 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:43.874316 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:13:44.019613 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.019516 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6a109f2-f69b-4e70-a42e-b01349a1d5da-kube-api-access-6dktw\" (UniqueName: \"kubernetes.io/projected/f6a109f2-f69b-4e70-a42e-b01349a1d5da-kube-api-access-6dktw\") pod \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " Nov 03 20:13:44.019613 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.019610 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-kube-api-access-sgmkd\" (UniqueName: \"kubernetes.io/projected/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-kube-api-access-sgmkd\") pod \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " Nov 03 20:13:44.019857 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.019646 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f6a109f2-f69b-4e70-a42e-b01349a1d5da-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a109f2-f69b-4e70-a42e-b01349a1d5da-plugins-config-volume\") pod \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\" (UID: \"f6a109f2-f69b-4e70-a42e-b01349a1d5da\") " Nov 03 20:13:44.019857 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.019748 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-plugins-config-volume\") pod \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\" (UID: \"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db\") " Nov 03 20:13:44.020153 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.020128 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-plugins-config-volume" pod "0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" (UID: "0b9b3fb2-19a9-429d-b8e3-fc71be61b1db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:13:44.020153 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.020136 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6a109f2-f69b-4e70-a42e-b01349a1d5da-plugins-config-volume" pod "f6a109f2-f69b-4e70-a42e-b01349a1d5da" (UID: "f6a109f2-f69b-4e70-a42e-b01349a1d5da"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:13:44.021952 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.021915 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-kube-api-access-sgmkd" pod "0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" (UID: "0b9b3fb2-19a9-429d-b8e3-fc71be61b1db"). InnerVolumeSpecName "kube-api-access-sgmkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:44.022026 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.021963 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a109f2-f69b-4e70-a42e-b01349a1d5da-kube-api-access-6dktw" pod "f6a109f2-f69b-4e70-a42e-b01349a1d5da" (UID: "f6a109f2-f69b-4e70-a42e-b01349a1d5da"). InnerVolumeSpecName "kube-api-access-6dktw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:44.039062 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.039033 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:44.121319 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.121291 5024 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-plugins-config-volume\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:44.121319 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.121314 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dktw\" (UniqueName: \"kubernetes.io/projected/f6a109f2-f69b-4e70-a42e-b01349a1d5da-kube-api-access-6dktw\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:44.121319 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.121325 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgmkd\" (UniqueName: \"kubernetes.io/projected/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db-kube-api-access-sgmkd\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:44.121550 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.121334 5024 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6a109f2-f69b-4e70-a42e-b01349a1d5da-plugins-config-volume\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:44.525366 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.525327 5024 generic.go:356] "Generic (PLEG): container finished" podID="f6a109f2-f69b-4e70-a42e-b01349a1d5da" containerID="f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787" exitCode=0 Nov 03 20:13:44.525835 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.525379 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" Nov 03 20:13:44.525835 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.525400 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" event={"ID":"f6a109f2-f69b-4e70-a42e-b01349a1d5da","Type":"ContainerDied","Data":"f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787"} Nov 03 20:13:44.525835 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.525451 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l" event={"ID":"f6a109f2-f69b-4e70-a42e-b01349a1d5da","Type":"ContainerDied","Data":"2b22f07c410df14d068321ee6a9bea00320f13fcd98d8090ec06b176848d6d2d"} Nov 03 20:13:44.525835 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.525474 5024 scope.go:122] "RemoveContainer" containerID="f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787" Nov 03 20:13:44.527195 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.527171 5024 generic.go:356] "Generic (PLEG): container finished" podID="0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" containerID="de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f" exitCode=0 Nov 03 20:13:44.527313 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.527227 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" event={"ID":"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db","Type":"ContainerDied","Data":"de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f"} Nov 03 20:13:44.527313 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.527257 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" event={"ID":"0b9b3fb2-19a9-429d-b8e3-fc71be61b1db","Type":"ContainerDied","Data":"162676b72652e011ba493c6c5efa5ffeee7a8f7e7e00acd91f6092173c569dd7"} Nov 03 20:13:44.527313 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.527275 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494" Nov 03 20:13:44.535625 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.535606 5024 scope.go:122] "RemoveContainer" containerID="f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787" Nov 03 20:13:44.535964 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:13:44.535941 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787\": container with ID starting with f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787 not found: ID does not exist" containerID="f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787" Nov 03 20:13:44.536042 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.535977 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787"} err="failed to get container status \"f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787\": rpc error: code = NotFound desc = could not find container \"f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787\": container with ID starting with f9c88c662cdb515f44e91eb7c62b45736680dc59a63304a6dc37e21610a79787 not found: ID does not exist" Nov 03 20:13:44.536042 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.536000 5024 scope.go:122] "RemoveContainer" containerID="de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f" Nov 03 20:13:44.544803 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.544787 5024 scope.go:122] "RemoveContainer" containerID="de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f" Nov 03 20:13:44.545101 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:13:44.545078 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f\": container with ID starting with de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f not found: ID does not exist" containerID="de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f" Nov 03 20:13:44.545180 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.545111 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f"} err="failed to get container status \"de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f\": rpc error: code = NotFound desc = could not find container \"de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f\": container with ID starting with de90956aca67e3edf0ae6f30d2930ceeee9d24d52cfc1cb8ebb7e51400ad133f not found: ID does not exist" Nov 03 20:13:44.690428 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.690395 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l"] Nov 03 20:13:44.739945 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.739891 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-main-e56f6e-754b95b59-df49l"] Nov 03 20:13:44.803035 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.802995 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494"] Nov 03 20:13:44.806920 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:44.806892 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-main-e56f6e-6c854875f4-s4494"] Nov 03 20:13:45.239679 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:45.239633 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:45.461419 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:45.461378 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:46.060653 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:46.060620 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8"] Nov 03 20:13:46.061169 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:46.060810 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" containerID="cri-o://d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8" gracePeriod=30 Nov 03 20:13:46.150951 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:46.141696 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:46.334719 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:46.334620 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" path="/var/lib/kubelet/pods/0b9b3fb2-19a9-429d-b8e3-fc71be61b1db/volumes" Nov 03 20:13:46.335143 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:46.335122 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6a109f2-f69b-4e70-a42e-b01349a1d5da" path="/var/lib/kubelet/pods/f6a109f2-f69b-4e70-a42e-b01349a1d5da/volumes" Nov 03 20:13:46.817863 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:46.817823 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:49.343241 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:49.343207 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:50.627622 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:50.627592 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:51.327376 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.327310 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:13:51.396231 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396192 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istiod-ca-cert\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396231 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396234 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-socket\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396507 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396280 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-token\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-token\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396507 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396309 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-certs\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396507 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396326 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-podinfo\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396507 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396352 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-credential-socket\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396507 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396380 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-envoy\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396507 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396451 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-data\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396520 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-kube-api-access-wb4n5\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-kube-api-access-wb4n5\") pod \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\" (UID: \"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5\") " Nov 03 20:13:51.396802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396656 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-certs" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:51.396802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396681 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-credential-socket" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:51.396802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396692 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istiod-ca-cert" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:13:51.397046 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396863 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-data" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:51.397046 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396879 5024 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-credential-socket\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.397046 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396884 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-socket" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:51.397046 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396912 5024 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istiod-ca-cert\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.397046 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.396974 5024 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-certs\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.398770 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.398747 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-token" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:51.398882 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.398780 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-podinfo" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 20:13:51.398882 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.398779 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-envoy" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:13:51.398984 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.398890 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-kube-api-access-wb4n5" pod "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" (UID: "4f2f9d73-3d61-4097-8c0d-ad3f90e6def5"). InnerVolumeSpecName "kube-api-access-wb4n5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:51.497793 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.497752 5024 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-data\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.497793 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.497795 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb4n5\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-kube-api-access-wb4n5\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.497793 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.497810 5024 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-workload-socket\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.498096 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.497822 5024 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-token\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.498096 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.497834 5024 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-podinfo\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.498096 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.497847 5024 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5-istio-envoy\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:51.577646 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.577554 5024 generic.go:356] "Generic (PLEG): container finished" podID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerID="d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8" exitCode=0 Nov 03 20:13:51.577646 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.577616 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" Nov 03 20:13:51.577840 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.577640 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" event={"ID":"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5","Type":"ContainerDied","Data":"d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8"} Nov 03 20:13:51.577840 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.577697 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8" event={"ID":"4f2f9d73-3d61-4097-8c0d-ad3f90e6def5","Type":"ContainerDied","Data":"0b91bd7fa863735b08dfaa0e36aff304bdbf94326224c6fb9fd3b05f52768eec"} Nov 03 20:13:51.577840 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.577724 5024 scope.go:122] "RemoveContainer" containerID="d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8" Nov 03 20:13:51.588665 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.588643 5024 scope.go:122] "RemoveContainer" containerID="917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712" Nov 03 20:13:51.598818 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.598027 5024 scope.go:122] "RemoveContainer" containerID="d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8" Nov 03 20:13:51.598818 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:13:51.598321 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8\": container with ID starting with d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8 not found: ID does not exist" containerID="d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8" Nov 03 20:13:51.598818 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.598350 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8"} err="failed to get container status \"d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8\": rpc error: code = NotFound desc = could not find container \"d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8\": container with ID starting with d1bf3f3969cfd4f907793655ead3757d1e431be4d3955d70391ed64639a0c5b8 not found: ID does not exist" Nov 03 20:13:51.598818 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.598370 5024 scope.go:122] "RemoveContainer" containerID="917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712" Nov 03 20:13:51.598818 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:13:51.598575 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712\": container with ID starting with 917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712 not found: ID does not exist" containerID="917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712" Nov 03 20:13:51.598818 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.598611 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712"} err="failed to get container status \"917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712\": rpc error: code = NotFound desc = could not find container \"917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712\": container with ID starting with 917e97ddfe3d01ece5365bce8512ca4dd5c8f20d941170f93d92390e93b3d712 not found: ID does not exist" Nov 03 20:13:51.744855 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.744818 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8"] Nov 03 20:13:51.747837 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:51.747814 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-main-e56f6e-openshift-default-656776d9d5-5j8b8"] Nov 03 20:13:52.335058 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:52.335028 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" path="/var/lib/kubelet/pods/4f2f9d73-3d61-4097-8c0d-ad3f90e6def5/volumes" Nov 03 20:13:52.934523 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:52.934473 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:53.924488 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:53.924457 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g"] Nov 03 20:13:54.221799 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:54.221701 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:54.401816 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:54.401774 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:55.824591 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:55.824556 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:58.925037 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:58.924975 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" podUID="5f56c582-ead6-42d1-b34c-efcb13167941" containerName="payload-pre-processing" containerID="cri-o://61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d" gracePeriod=25 Nov 03 20:13:58.993764 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:58.993725 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:13:59.184732 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.184668 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:13:59.274548 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.274511 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5f56c582-ead6-42d1-b34c-efcb13167941-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c582-ead6-42d1-b34c-efcb13167941-plugins-config-volume\") pod \"5f56c582-ead6-42d1-b34c-efcb13167941\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " Nov 03 20:13:59.274548 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.274551 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5f56c582-ead6-42d1-b34c-efcb13167941-kube-api-access-kmvd8\" (UniqueName: \"kubernetes.io/projected/5f56c582-ead6-42d1-b34c-efcb13167941-kube-api-access-kmvd8\") pod \"5f56c582-ead6-42d1-b34c-efcb13167941\" (UID: \"5f56c582-ead6-42d1-b34c-efcb13167941\") " Nov 03 20:13:59.275018 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.274967 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f56c582-ead6-42d1-b34c-efcb13167941-plugins-config-volume" pod "5f56c582-ead6-42d1-b34c-efcb13167941" (UID: "5f56c582-ead6-42d1-b34c-efcb13167941"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:13:59.276765 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.276742 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f56c582-ead6-42d1-b34c-efcb13167941-kube-api-access-kmvd8" pod "5f56c582-ead6-42d1-b34c-efcb13167941" (UID: "5f56c582-ead6-42d1-b34c-efcb13167941"). InnerVolumeSpecName "kube-api-access-kmvd8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:13:59.375689 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.375653 5024 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5f56c582-ead6-42d1-b34c-efcb13167941-plugins-config-volume\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:59.375689 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.375682 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmvd8\" (UniqueName: \"kubernetes.io/projected/5f56c582-ead6-42d1-b34c-efcb13167941-kube-api-access-kmvd8\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:13:59.639271 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.639238 5024 generic.go:356] "Generic (PLEG): container finished" podID="5f56c582-ead6-42d1-b34c-efcb13167941" containerID="61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d" exitCode=0 Nov 03 20:13:59.639427 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.639280 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" Nov 03 20:13:59.639427 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.639319 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" event={"ID":"5f56c582-ead6-42d1-b34c-efcb13167941","Type":"ContainerDied","Data":"61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d"} Nov 03 20:13:59.639427 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.639371 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g" event={"ID":"5f56c582-ead6-42d1-b34c-efcb13167941","Type":"ContainerDied","Data":"f4b617578e0a1f45829b3bedc342d56ab882d06697c1d229122d6e48939b0665"} Nov 03 20:13:59.639427 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.639398 5024 scope.go:122] "RemoveContainer" containerID="61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d" Nov 03 20:13:59.649321 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.649301 5024 scope.go:122] "RemoveContainer" containerID="61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d" Nov 03 20:13:59.649604 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:13:59.649582 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d\": container with ID starting with 61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d not found: ID does not exist" containerID="61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d" Nov 03 20:13:59.649682 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.649617 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d"} err="failed to get container status \"61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d\": rpc error: code = NotFound desc = could not find container \"61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d\": container with ID starting with 61530e001a3a4b32037791f0b0ba67b08894c702f53cf9b8e301be207483b54d not found: ID does not exist" Nov 03 20:13:59.804176 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.804139 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g"] Nov 03 20:13:59.854033 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:13:59.853993 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-main-12288c-67c58f56c96ms6g"] Nov 03 20:14:00.275518 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:00.275485 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:00.339398 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:00.339367 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5f56c582-ead6-42d1-b34c-efcb13167941" path="/var/lib/kubelet/pods/5f56c582-ead6-42d1-b34c-efcb13167941/volumes" Nov 03 20:14:04.726366 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:04.726292 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:04.902158 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:04.902123 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:06.049641 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:06.049612 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl"] Nov 03 20:14:06.098970 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:06.098936 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-28a610b5-9mwvl"] Nov 03 20:14:06.242385 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:06.242344 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:06.335273 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:06.335182 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="06d5a976-9b98-4f8f-a038-48daef90f354" path="/var/lib/kubelet/pods/06d5a976-9b98-4f8f-a038-48daef90f354/volumes" Nov 03 20:14:06.698618 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:06.698587 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r"] Nov 03 20:14:06.698811 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:06.698789 5024 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" containerID="cri-o://685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce" gracePeriod=30 Nov 03 20:14:06.732886 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:06.732854 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:07.571784 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:14:07.571751 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:14:11.045921 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:11.045888 5024 patch_prober.go:29] interesting pod/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 03 20:14:11.046315 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:11.045995 5024 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 03 20:14:11.954642 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:11.954613 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:14:12.106536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106440 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-envoy\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.106536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106503 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-data\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.106536 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106532 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-token\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-token\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106590 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6c486a00-f259-4f5b-bab9-ddf48a063854-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c486a00-f259-4f5b-bab9-ddf48a063854-istiod-ca-cert\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106627 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-kube-api-access-wdqdg\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-kube-api-access-wdqdg\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106675 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-podinfo\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106911 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-data" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.106997 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-certs\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107050 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-credential-socket\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107090 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-socket\") pod \"6c486a00-f259-4f5b-bab9-ddf48a063854\" (UID: \"6c486a00-f259-4f5b-bab9-ddf48a063854\") " Nov 03 20:14:12.107245 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107123 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c486a00-f259-4f5b-bab9-ddf48a063854-istiod-ca-cert" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:14:12.107819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107525 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-credential-socket" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:14:12.107819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107690 5024 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c486a00-f259-4f5b-bab9-ddf48a063854-istiod-ca-cert\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.107819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107698 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-socket" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:14:12.107819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107714 5024 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-credential-socket\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.107819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107729 5024 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-data\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.107819 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.107761 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-certs" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:14:12.109200 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.109171 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-token" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:14:12.109328 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.109281 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-envoy" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 03 20:14:12.109609 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.109577 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-kube-api-access-wdqdg" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "kube-api-access-wdqdg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:14:12.109860 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.109833 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-podinfo" pod "6c486a00-f259-4f5b-bab9-ddf48a063854" (UID: "6c486a00-f259-4f5b-bab9-ddf48a063854"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 03 20:14:12.208337 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.208304 5024 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-podinfo\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.208337 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.208332 5024 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-certs\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.208337 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.208342 5024 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-workload-socket\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.208578 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.208351 5024 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-envoy\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.208578 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.208360 5024 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-istio-token\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.208578 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.208382 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdqdg\" (UniqueName: \"kubernetes.io/projected/6c486a00-f259-4f5b-bab9-ddf48a063854-kube-api-access-wdqdg\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:14:12.721793 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.721756 5024 generic.go:356] "Generic (PLEG): container finished" podID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerID="685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce" exitCode=0 Nov 03 20:14:12.721986 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.721798 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" Nov 03 20:14:12.721986 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.721838 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" event={"ID":"6c486a00-f259-4f5b-bab9-ddf48a063854","Type":"ContainerDied","Data":"685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce"} Nov 03 20:14:12.721986 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.721893 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r" event={"ID":"6c486a00-f259-4f5b-bab9-ddf48a063854","Type":"ContainerDied","Data":"312408bb5c307f32fbbc78e39ff93b04f946dbaf177df03cfd00829a04b6ee35"} Nov 03 20:14:12.721986 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.721914 5024 scope.go:122] "RemoveContainer" containerID="685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce" Nov 03 20:14:12.731647 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.731633 5024 scope.go:122] "RemoveContainer" containerID="534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0" Nov 03 20:14:12.740407 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.740390 5024 scope.go:122] "RemoveContainer" containerID="685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce" Nov 03 20:14:12.740651 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:14:12.740625 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce\": container with ID starting with 685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce not found: ID does not exist" containerID="685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce" Nov 03 20:14:12.740731 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.740659 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce"} err="failed to get container status \"685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce\": rpc error: code = NotFound desc = could not find container \"685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce\": container with ID starting with 685c94b99631e0e8d73c7ea54e9adb9033d99edd87b9c76bf542a0461dc764ce not found: ID does not exist" Nov 03 20:14:12.740731 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.740683 5024 scope.go:122] "RemoveContainer" containerID="534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0" Nov 03 20:14:12.740984 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:14:12.740967 5024 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0\": container with ID starting with 534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0 not found: ID does not exist" containerID="534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0" Nov 03 20:14:12.741033 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.740992 5024 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0"} err="failed to get container status \"534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0\": rpc error: code = NotFound desc = could not find container \"534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0\": container with ID starting with 534e168743cc40c7aca37d559589367bcc97438829b0c9dc86ba8c79fbe90ed0 not found: ID does not exist" Nov 03 20:14:12.888038 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.888002 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r"] Nov 03 20:14:12.938284 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:12.938257 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-main-12288c-openshift-default-754fff74df-9jc5r"] Nov 03 20:14:14.335214 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:14.335167 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" path="/var/lib/kubelet/pods/6c486a00-f259-4f5b-bab9-ddf48a063854/volumes" Nov 03 20:14:20.747324 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:20.747293 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-6hch7_561d6e07-50cc-4c3f-b401-facef6d19780/manager/0.log" Nov 03 20:14:21.049483 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:21.049399 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7"] Nov 03 20:14:21.098956 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:21.098913 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-40b5ab3d-mtxt7"] Nov 03 20:14:22.336379 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:22.336344 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7b6ce255-74f2-47c2-ab72-13174bcbdfef" path="/var/lib/kubelet/pods/7b6ce255-74f2-47c2-ab72-13174bcbdfef/volumes" Nov 03 20:14:23.927602 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:23.927570 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-5c22c397-gx7jl_53cfe0ad-25f6-44ec-8a8a-9236efb76973/revoke-keys/0.log" Nov 03 20:14:24.155060 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:24.155027 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-6d4b62e3-sn2jr_40a72a6d-a767-4bf2-be13-11b02b87e5f0/revoke-keys/0.log" Nov 03 20:14:24.368119 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:24.368043 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-73050a3f-z8zv5_a8aeb621-0ec1-4163-b78e-486181a71715/revoke-keys/0.log" Nov 03 20:14:24.595661 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:24.595633 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9abbcc44-j76xt_8daacab3-9449-4329-b684-b6b747bf4750/revoke-keys/0.log" Nov 03 20:14:24.823013 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:24.822985 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-cf6baee9-khsrm_7e42d136-f417-4552-b53f-269d0eb52c59/revoke-keys/0.log" Nov 03 20:14:25.049001 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:25.048969 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-d6a644bc-t7jfh_3e570d22-b598-4098-834b-529901eadcb1/revoke-keys/0.log" Nov 03 20:14:25.264091 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:25.264062 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-ed5585c5-fc4dc_9709dfa0-3b96-4bc5-85b4-a62133d95e9d/revoke-keys/0.log" Nov 03 20:14:25.485808 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:25.485773 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-ef4fc6f6-b9cxl_12771b68-6e97-496e-8d24-7428cf9f4161/revoke-keys/0.log" Nov 03 20:14:25.703645 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:25.703618 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f719a87a-wnhjv_0c120d25-fe1a-4949-a1ae-927fa64af31e/revoke-keys/0.log" Nov 03 20:14:25.939175 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:25.939145 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-cs9mx_12b72a14-0cc7-455a-8255-77e3d4a112bb/postgres/0.log" Nov 03 20:14:28.112041 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:28.112005 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:28.449330 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:28.449296 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:28.485944 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:28.485896 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-pdd6r_d1d835fd-33ea-47c0-a306-929c8ac31e13/manager/0.log" Nov 03 20:14:29.265291 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:29.265263 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-85txq_fb726d2e-89ab-4754-af02-537fdea524f3/manager/0.log" Nov 03 20:14:29.916762 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:29.916727 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-2sxcf_80170616-a5ce-47e9-bda2-2cd8695aa3f1/manager/0.log" Nov 03 20:14:30.960316 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:30.960275 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-76f56c5945fk5rx_4e0025fc-d687-4181-9123-976fe02bcdbe/istio-proxy/0.log" Nov 03 20:14:32.403069 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:32.403031 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-gvnng_83837dc2-b70c-4109-9327-6bdfb43a9d71/istio-proxy/0.log" Nov 03 20:14:33.049007 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:33.048971 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv"] Nov 03 20:14:33.085320 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:33.085288 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-n79ks_dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9/istio-proxy/0.log" Nov 03 20:14:33.098741 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:33.098711 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f719a87a-wnhjv"] Nov 03 20:14:33.300718 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:33.300624 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-q6cx2_f6f75017-0a57-4f8c-b105-c8434fc35780/istio-proxy/1.log" Nov 03 20:14:33.831051 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:33.831021 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-xj5qx_40cca8d5-0ecc-48f9-a56b-d46cd2359f4f/istio-proxy/0.log" Nov 03 20:14:34.329332 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:34.329307 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm_771d9633-4f77-4d28-aca7-4793afd51903/istio-proxy/0.log" Nov 03 20:14:34.334170 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:34.334143 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0c120d25-fe1a-4949-a1ae-927fa64af31e" path="/var/lib/kubelet/pods/0c120d25-fe1a-4949-a1ae-927fa64af31e/volumes" Nov 03 20:14:34.989105 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:34.989080 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d7978dc5-vflbf_6b517d3a-c283-4a81-a5ee-bd217d966bce/router/0.log" Nov 03 20:14:35.692045 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:35.692010 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-q6cx2_f6f75017-0a57-4f8c-b105-c8434fc35780/istio-proxy/0.log" Nov 03 20:14:36.801289 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:36.801262 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-ttrwc_c1a2e45d-cfdb-436c-b7fd-8f3fc3011bf0/main/0.log" Nov 03 20:14:37.271499 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:37.271473 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8c7zc5_af09eb54-4791-4d4c-bb1e-59ea69a00413/main/0.log" Nov 03 20:14:37.572272 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:14:37.572192 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:14:37.713394 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:37.713366 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-n5w2t_4c0d42b4-24ee-4f91-81cb-e262e9fb24ae/main/0.log" Nov 03 20:14:43.049356 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:43.049318 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh"] Nov 03 20:14:43.099095 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:43.099060 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d6a644bc-t7jfh"] Nov 03 20:14:44.334325 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:44.334290 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e570d22-b598-4098-834b-529901eadcb1" path="/var/lib/kubelet/pods/3e570d22-b598-4098-834b-529901eadcb1/volumes" Nov 03 20:14:46.350786 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:46.350746 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:48.007247 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.007217 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:48.063868 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.063838 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4jfrw/must-gather-25wx9"] Nov 03 20:14:48.064290 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064277 5024 cpu_manager.go:414] "containerMap: removing container" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" Nov 03 20:14:48.064339 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064292 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" Nov 03 20:14:48.064339 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064308 5024 cpu_manager.go:414] "containerMap: removing container" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" Nov 03 20:14:48.064339 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064313 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" Nov 03 20:14:48.064339 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064320 5024 cpu_manager.go:414] "containerMap: removing container" podUID="53cfe0ad-25f6-44ec-8a8a-9236efb76973" containerName="revoke-keys" Nov 03 20:14:48.064339 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064325 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53cfe0ad-25f6-44ec-8a8a-9236efb76973" containerName="revoke-keys" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064341 5024 cpu_manager.go:414] "containerMap: removing container" podUID="0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" containerName="payload-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064345 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" containerName="payload-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064356 5024 cpu_manager.go:414] "containerMap: removing container" podUID="f6a109f2-f69b-4e70-a42e-b01349a1d5da" containerName="payload-pre-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064361 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6a109f2-f69b-4e70-a42e-b01349a1d5da" containerName="payload-pre-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064370 5024 cpu_manager.go:414] "containerMap: removing container" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064374 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064389 5024 cpu_manager.go:414] "containerMap: removing container" podUID="5f56c582-ead6-42d1-b34c-efcb13167941" containerName="payload-pre-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064393 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5f56c582-ead6-42d1-b34c-efcb13167941" containerName="payload-pre-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064454 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b9b3fb2-19a9-429d-b8e3-fc71be61b1db" containerName="payload-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064462 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6a109f2-f69b-4e70-a42e-b01349a1d5da" containerName="payload-pre-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064470 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064476 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064484 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="5f56c582-ead6-42d1-b34c-efcb13167941" containerName="payload-pre-processing" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064489 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="6c486a00-f259-4f5b-bab9-ddf48a063854" containerName="istio-proxy" Nov 03 20:14:48.064489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064494 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="53cfe0ad-25f6-44ec-8a8a-9236efb76973" containerName="revoke-keys" Nov 03 20:14:48.065312 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064560 5024 cpu_manager.go:414] "containerMap: removing container" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" Nov 03 20:14:48.065312 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064566 5024 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" Nov 03 20:14:48.065312 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.064636 5024 memory_manager.go:365] "RemoveStaleState removing state" podUID="4f2f9d73-3d61-4097-8c0d-ad3f90e6def5" containerName="istio-proxy" Nov 03 20:14:48.070032 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.069509 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.126866 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.126830 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jfrw/must-gather-25wx9"] Nov 03 20:14:48.127381 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.127358 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e73fdd15-ff19-48f8-9c45-dc442d2b92ac-must-gather-output\") pod \"must-gather-25wx9\" (UID: \"e73fdd15-ff19-48f8-9c45-dc442d2b92ac\") " pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.127489 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.127474 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ht7k\" (UniqueName: \"kubernetes.io/projected/e73fdd15-ff19-48f8-9c45-dc442d2b92ac-kube-api-access-4ht7k\") pod \"must-gather-25wx9\" (UID: \"e73fdd15-ff19-48f8-9c45-dc442d2b92ac\") " pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.171978 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.171916 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4jfrw\"/\"openshift-service-ca.crt\"" Nov 03 20:14:48.172158 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.172056 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4jfrw\"/\"kube-root-ca.crt\"" Nov 03 20:14:48.172158 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.172063 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4jfrw\"/\"default-dockercfg-cpmtp\"" Nov 03 20:14:48.211538 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.211505 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:48.227975 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.227946 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e73fdd15-ff19-48f8-9c45-dc442d2b92ac-must-gather-output\") pod \"must-gather-25wx9\" (UID: \"e73fdd15-ff19-48f8-9c45-dc442d2b92ac\") " pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.228099 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.228001 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ht7k\" (UniqueName: \"kubernetes.io/projected/e73fdd15-ff19-48f8-9c45-dc442d2b92ac-kube-api-access-4ht7k\") pod \"must-gather-25wx9\" (UID: \"e73fdd15-ff19-48f8-9c45-dc442d2b92ac\") " pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.228303 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.228284 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e73fdd15-ff19-48f8-9c45-dc442d2b92ac-must-gather-output\") pod \"must-gather-25wx9\" (UID: \"e73fdd15-ff19-48f8-9c45-dc442d2b92ac\") " pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.293833 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.293758 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ht7k\" (UniqueName: \"kubernetes.io/projected/e73fdd15-ff19-48f8-9c45-dc442d2b92ac-kube-api-access-4ht7k\") pod \"must-gather-25wx9\" (UID: \"e73fdd15-ff19-48f8-9c45-dc442d2b92ac\") " pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.395123 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.395097 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4jfrw/must-gather-25wx9" Nov 03 20:14:48.767990 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.767963 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4jfrw/must-gather-25wx9"] Nov 03 20:14:48.768645 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:14:48.768605 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode73fdd15_ff19_48f8_9c45_dc442d2b92ac.slice/crio-0e1b9efa69c8cc214d94314ed1f9bb5311d8fc68157c316bc0b91d987904470c WatchSource:0}: Error finding container 0e1b9efa69c8cc214d94314ed1f9bb5311d8fc68157c316bc0b91d987904470c: Status 404 returned error can't find the container with id 0e1b9efa69c8cc214d94314ed1f9bb5311d8fc68157c316bc0b91d987904470c Nov 03 20:14:48.770597 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.770572 5024 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 03 20:14:48.958478 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:48.958442 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jfrw/must-gather-25wx9" event={"ID":"e73fdd15-ff19-48f8-9c45-dc442d2b92ac","Type":"ContainerStarted","Data":"0e1b9efa69c8cc214d94314ed1f9bb5311d8fc68157c316bc0b91d987904470c"} Nov 03 20:14:49.686799 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:49.686760 5024 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" limit=1024 Nov 03 20:14:54.051484 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:54.051430 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5"] Nov 03 20:14:54.100859 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:54.100823 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-73050a3f-z8zv5"] Nov 03 20:14:54.336220 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:54.336139 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8aeb621-0ec1-4163-b78e-486181a71715" path="/var/lib/kubelet/pods/a8aeb621-0ec1-4163-b78e-486181a71715/volumes" Nov 03 20:14:56.016030 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:56.015988 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jfrw/must-gather-25wx9" event={"ID":"e73fdd15-ff19-48f8-9c45-dc442d2b92ac","Type":"ContainerStarted","Data":"c90b28c05d42fc5ccc13c186f174f95c70e9290f734698bf20a7094100930995"} Nov 03 20:14:56.016441 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:56.016045 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4jfrw/must-gather-25wx9" event={"ID":"e73fdd15-ff19-48f8-9c45-dc442d2b92ac","Type":"ContainerStarted","Data":"c257504b1f5b95ef436c43e849e7643c971f1fb8c0349fc5c1b61a431101fef5"} Nov 03 20:14:56.133361 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:56.133307 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-4jfrw/must-gather-25wx9" podStartSLOduration=1.9015073729999998 podStartE2EDuration="8.133293076s" totalImagesPullingTime="6.231785703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:14:56.131034281 +0000 UTC m=+1443.912750949" watchObservedRunningTime="2026-11-03 20:14:56.133293076 +0000 UTC m=+1443.915009743" Nov 03 20:14:57.647514 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:57.647485 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jllnn_62ac74a8-8df8-48fd-8a09-9ce51991bd84/global-pull-secret-syncer/0.log" Nov 03 20:14:58.876810 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:58.876782 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-bf2vl_618261dd-822b-486a-8cd0-40b16e371320/connection-checker/0.log" Nov 03 20:14:59.309264 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:59.309236 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-jv7xp_616120e6-f7d2-4ca3-985d-80c1e53bc3b7/connection-checker/0.log" Nov 03 20:14:59.648798 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:59.648766 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-6hch7_561d6e07-50cc-4c3f-b401-facef6d19780/manager/0.log" Nov 03 20:14:59.740833 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:14:59.740798 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-sk2cf_9300cd63-4b10-4876-96a3-7130ff5d35c7/connection-checker/0.log" Nov 03 20:15:00.169235 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.169196 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf"] Nov 03 20:15:00.175056 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.175033 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.188769 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.188748 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-25m4r_c3eeb01d-abf0-404d-bae0-5810acc09628/konnectivity-agent/0.log" Nov 03 20:15:00.227403 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.227370 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8h55c\"" Nov 03 20:15:00.260350 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.260312 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4vcv\" (UniqueName: \"kubernetes.io/projected/7c87811f-3f27-4d20-a79a-42434b2598e4-kube-api-access-j4vcv\") pod \"maas-api-key-cleanup-29895615-6sxjf\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.260525 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.260378 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c87811f-3f27-4d20-a79a-42434b2598e4-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895615-6sxjf\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.279842 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.279805 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf"] Nov 03 20:15:00.361081 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.361049 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4vcv\" (UniqueName: \"kubernetes.io/projected/7c87811f-3f27-4d20-a79a-42434b2598e4-kube-api-access-j4vcv\") pod \"maas-api-key-cleanup-29895615-6sxjf\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.361271 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.361088 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c87811f-3f27-4d20-a79a-42434b2598e4-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895615-6sxjf\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.361727 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.361705 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c87811f-3f27-4d20-a79a-42434b2598e4-maas-api-service-ca\") pod \"maas-api-key-cleanup-29895615-6sxjf\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.422780 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.422709 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4vcv\" (UniqueName: \"kubernetes.io/projected/7c87811f-3f27-4d20-a79a-42434b2598e4-kube-api-access-j4vcv\") pod \"maas-api-key-cleanup-29895615-6sxjf\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.490321 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.490286 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:00.866806 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:00.866773 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf"] Nov 03 20:15:00.867751 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:15:00.867719 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c87811f_3f27_4d20_a79a_42434b2598e4.slice/crio-13731bcee48f1ac681fa239bf457061f5647db432a62913e0a36bf3d9af46b1f WatchSource:0}: Error finding container 13731bcee48f1ac681fa239bf457061f5647db432a62913e0a36bf3d9af46b1f: Status 404 returned error can't find the container with id 13731bcee48f1ac681fa239bf457061f5647db432a62913e0a36bf3d9af46b1f Nov 03 20:15:01.052002 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:01.051957 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" event={"ID":"7c87811f-3f27-4d20-a79a-42434b2598e4","Type":"ContainerStarted","Data":"13731bcee48f1ac681fa239bf457061f5647db432a62913e0a36bf3d9af46b1f"} Nov 03 20:15:01.917802 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:01.917724 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-64.us-west-1.compute.internal_2be11478d32fa8c827db5f33a49eaff7/haproxy/0.log" Nov 03 20:15:02.059884 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:02.059842 5024 generic.go:356] "Generic (PLEG): container finished" podID="7c87811f-3f27-4d20-a79a-42434b2598e4" containerID="90ddb460706253a464ad0d0a5669374567d3c865ff90f135dddf06288cd103d8" exitCode=60 Nov 03 20:15:02.060103 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:02.059954 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" event={"ID":"7c87811f-3f27-4d20-a79a-42434b2598e4","Type":"ContainerDied","Data":"90ddb460706253a464ad0d0a5669374567d3c865ff90f135dddf06288cd103d8"} Nov 03 20:15:02.060223 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:02.060209 5024 scope.go:122] "RemoveContainer" containerID="90ddb460706253a464ad0d0a5669374567d3c865ff90f135dddf06288cd103d8" Nov 03 20:15:03.071637 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:03.071605 5024 generic.go:356] "Generic (PLEG): container finished" podID="7c87811f-3f27-4d20-a79a-42434b2598e4" containerID="860b7656fd9cab016dac37f8c154010593886af69f3f1735122ff2097e403600" exitCode=60 Nov 03 20:15:03.072078 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:03.071683 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" event={"ID":"7c87811f-3f27-4d20-a79a-42434b2598e4","Type":"ContainerDied","Data":"860b7656fd9cab016dac37f8c154010593886af69f3f1735122ff2097e403600"} Nov 03 20:15:03.072078 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:03.071744 5024 scope.go:122] "RemoveContainer" containerID="90ddb460706253a464ad0d0a5669374567d3c865ff90f135dddf06288cd103d8" Nov 03 20:15:03.072078 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:03.072015 5024 scope.go:122] "RemoveContainer" containerID="860b7656fd9cab016dac37f8c154010593886af69f3f1735122ff2097e403600" Nov 03 20:15:03.072339 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:15:03.072319 5024 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895615-6sxjf_odh-ai-gateway-infra(7c87811f-3f27-4d20-a79a-42434b2598e4)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" podUID="7c87811f-3f27-4d20-a79a-42434b2598e4" Nov 03 20:15:04.079580 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:04.079546 5024 scope.go:122] "RemoveContainer" containerID="860b7656fd9cab016dac37f8c154010593886af69f3f1735122ff2097e403600" Nov 03 20:15:04.080010 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:15:04.079797 5024 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29895615-6sxjf_odh-ai-gateway-infra(7c87811f-3f27-4d20-a79a-42434b2598e4)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" podUID="7c87811f-3f27-4d20-a79a-42434b2598e4" Nov 03 20:15:04.320244 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:04.320215 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-6hch7_561d6e07-50cc-4c3f-b401-facef6d19780/manager/0.log" Nov 03 20:15:05.049445 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:05.049403 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc"] Nov 03 20:15:05.099867 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:05.099838 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ed5585c5-fc4dc"] Nov 03 20:15:06.335774 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:06.335743 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9709dfa0-3b96-4bc5-85b4-a62133d95e9d" path="/var/lib/kubelet/pods/9709dfa0-3b96-4bc5-85b4-a62133d95e9d/volumes" Nov 03 20:15:06.631843 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:06.631771 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-pdd6r_d1d835fd-33ea-47c0-a306-929c8ac31e13/manager/0.log" Nov 03 20:15:07.395909 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.395857 5024 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c"] Nov 03 20:15:07.403120 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.403093 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.451060 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.451024 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-proc\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.451215 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.451068 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-lib-modules\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.451215 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.451093 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-podres\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.451282 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.451234 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mwjj\" (UniqueName: \"kubernetes.io/projected/56a2c198-8b9c-4af4-8758-329fa6af9ca7-kube-api-access-5mwjj\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.451342 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.451311 5024 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-sys\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.490562 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.490529 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c"] Nov 03 20:15:07.552767 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552734 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-sys\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.552968 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552816 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-proc\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.552968 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552838 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-sys\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.552968 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552852 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-lib-modules\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.552968 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552910 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-podres\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.552968 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552945 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-proc\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.552968 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552963 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-lib-modules\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.553258 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.552988 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56a2c198-8b9c-4af4-8758-329fa6af9ca7-podres\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.553258 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.553018 5024 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mwjj\" (UniqueName: \"kubernetes.io/projected/56a2c198-8b9c-4af4-8758-329fa6af9ca7-kube-api-access-5mwjj\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.568667 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.568639 5024 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4gtkw\"/\"default-dockercfg-w5sd2\"" Nov 03 20:15:07.568667 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.568641 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gtkw\"/\"kube-root-ca.crt\"" Nov 03 20:15:07.568667 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.568638 5024 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4gtkw\"/\"openshift-service-ca.crt\"" Nov 03 20:15:07.572880 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:15:07.572848 5024 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-dhz4z" containerName="extractor" Nov 03 20:15:07.614578 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.614544 5024 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mwjj\" (UniqueName: \"kubernetes.io/projected/56a2c198-8b9c-4af4-8758-329fa6af9ca7-kube-api-access-5mwjj\") pod \"perf-node-gather-daemonset-d495c\" (UID: \"56a2c198-8b9c-4af4-8758-329fa6af9ca7\") " pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:07.716614 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:07.716514 5024 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:08.012030 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:08.011947 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-85txq_fb726d2e-89ab-4754-af02-537fdea524f3/manager/0.log" Nov 03 20:15:08.097323 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:08.097289 5024 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c"] Nov 03 20:15:08.098216 ip-10-0-131-64 kubenswrapper[5024]: W1103 20:15:08.098182 5024 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod56a2c198_8b9c_4af4_8758_329fa6af9ca7.slice/crio-a7a68fb2346bb3e06515988a3ef9d7cd43dc45f618efd80cda192df8ab777c24 WatchSource:0}: Error finding container a7a68fb2346bb3e06515988a3ef9d7cd43dc45f618efd80cda192df8ab777c24: Status 404 returned error can't find the container with id a7a68fb2346bb3e06515988a3ef9d7cd43dc45f618efd80cda192df8ab777c24 Nov 03 20:15:08.107862 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:08.107825 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" event={"ID":"56a2c198-8b9c-4af4-8758-329fa6af9ca7","Type":"ContainerStarted","Data":"a7a68fb2346bb3e06515988a3ef9d7cd43dc45f618efd80cda192df8ab777c24"} Nov 03 20:15:08.837081 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:08.837030 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-2sxcf_80170616-a5ce-47e9-bda2-2cd8695aa3f1/manager/0.log" Nov 03 20:15:08.930629 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:08.930578 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-6hch7_561d6e07-50cc-4c3f-b401-facef6d19780/manager/0.log" Nov 03 20:15:09.116706 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:09.116615 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" event={"ID":"56a2c198-8b9c-4af4-8758-329fa6af9ca7","Type":"ContainerStarted","Data":"22950719e00879a3350560e7402c934e8e112f483ccdd8028bacf6f7b5c58e36"} Nov 03 20:15:09.116869 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:09.116718 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:09.236164 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:09.236113 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" podStartSLOduration=2.236098824 podStartE2EDuration="2.236098824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-03 20:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:15:09.235654774 +0000 UTC m=+1457.017371442" watchObservedRunningTime="2026-11-03 20:15:09.236098824 +0000 UTC m=+1457.017815487" Nov 03 20:15:13.392614 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:13.392585 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-76f56c5945fk5rx_4e0025fc-d687-4181-9123-976fe02bcdbe/istio-proxy/0.log" Nov 03 20:15:14.328728 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:14.328690 5024 scope.go:122] "RemoveContainer" containerID="860b7656fd9cab016dac37f8c154010593886af69f3f1735122ff2097e403600" Nov 03 20:15:14.434066 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:14.434027 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-24f98_cbebc1f6-9c14-406d-a918-f6857cc5b2cf/cluster-monitoring-operator/0.log" Nov 03 20:15:14.827695 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:14.827660 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-gvnng_83837dc2-b70c-4109-9327-6bdfb43a9d71/istio-proxy/0.log" Nov 03 20:15:15.136992 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:15.136865 5024 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4gtkw/perf-node-gather-daemonset-d495c" Nov 03 20:15:15.168240 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:15.168207 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" event={"ID":"7c87811f-3f27-4d20-a79a-42434b2598e4","Type":"ContainerStarted","Data":"6e803853c32190668b5687cb30ae2a4bb8acfbe3f1e82c75ecdd737655973883"} Nov 03 20:15:15.371453 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:15.371387 5024 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" podStartSLOduration=15.371370827 podStartE2EDuration="15.371370827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-03 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-03 20:15:15.36832305 +0000 UTC m=+1463.150039717" watchObservedRunningTime="2026-11-03 20:15:15.371370827 +0000 UTC m=+1463.153087495" Nov 03 20:15:15.484122 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:15.484087 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-n79ks_dc2ca20d-c22b-491f-a7f7-b8ea6c8673f9/istio-proxy/0.log" Nov 03 20:15:15.698454 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:15.698415 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-q6cx2_f6f75017-0a57-4f8c-b105-c8434fc35780/istio-proxy/0.log" Nov 03 20:15:15.699458 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:15.699427 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-q6cx2_f6f75017-0a57-4f8c-b105-c8434fc35780/istio-proxy/1.log" Nov 03 20:15:16.026982 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:16.026949 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-59f957fdd7-xj5qx_40cca8d5-0ecc-48f9-a56b-d46cd2359f4f/istio-proxy/0.log" Nov 03 20:15:16.177050 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:16.177018 5024 generic.go:356] "Generic (PLEG): container finished" podID="7c87811f-3f27-4d20-a79a-42434b2598e4" containerID="6e803853c32190668b5687cb30ae2a4bb8acfbe3f1e82c75ecdd737655973883" exitCode=60 Nov 03 20:15:16.177487 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:16.177100 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" event={"ID":"7c87811f-3f27-4d20-a79a-42434b2598e4","Type":"ContainerDied","Data":"6e803853c32190668b5687cb30ae2a4bb8acfbe3f1e82c75ecdd737655973883"} Nov 03 20:15:16.177487 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:16.177165 5024 scope.go:122] "RemoveContainer" containerID="860b7656fd9cab016dac37f8c154010593886af69f3f1735122ff2097e403600" Nov 03 20:15:16.177607 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:16.177509 5024 scope.go:122] "RemoveContainer" containerID="6e803853c32190668b5687cb30ae2a4bb8acfbe3f1e82c75ecdd737655973883" Nov 03 20:15:16.177793 ip-10-0-131-64 kubenswrapper[5024]: E1103 20:15:16.177774 5024 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29895615-6sxjf_odh-ai-gateway-infra(7c87811f-3f27-4d20-a79a-42434b2598e4)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" podUID="7c87811f-3f27-4d20-a79a-42434b2598e4" Nov 03 20:15:16.396094 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:16.396062 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf"] Nov 03 20:15:16.485384 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:16.485355 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-7cd79c685f-k9wnm_771d9633-4f77-4d28-aca7-4793afd51903/istio-proxy/0.log" Nov 03 20:15:17.146214 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.146186 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d7978dc5-vflbf_6b517d3a-c283-4a81-a5ee-bd217d966bce/router/0.log" Nov 03 20:15:17.352664 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.352636 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:17.449419 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.449329 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7c87811f-3f27-4d20-a79a-42434b2598e4-kube-api-access-j4vcv\" (UniqueName: \"kubernetes.io/projected/7c87811f-3f27-4d20-a79a-42434b2598e4-kube-api-access-j4vcv\") pod \"7c87811f-3f27-4d20-a79a-42434b2598e4\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " Nov 03 20:15:17.449599 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.449447 5024 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7c87811f-3f27-4d20-a79a-42434b2598e4-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c87811f-3f27-4d20-a79a-42434b2598e4-maas-api-service-ca\") pod \"7c87811f-3f27-4d20-a79a-42434b2598e4\" (UID: \"7c87811f-3f27-4d20-a79a-42434b2598e4\") " Nov 03 20:15:17.449858 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.449827 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c87811f-3f27-4d20-a79a-42434b2598e4-maas-api-service-ca" pod "7c87811f-3f27-4d20-a79a-42434b2598e4" (UID: "7c87811f-3f27-4d20-a79a-42434b2598e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 03 20:15:17.451672 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.451642 5024 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c87811f-3f27-4d20-a79a-42434b2598e4-kube-api-access-j4vcv" pod "7c87811f-3f27-4d20-a79a-42434b2598e4" (UID: "7c87811f-3f27-4d20-a79a-42434b2598e4"). InnerVolumeSpecName "kube-api-access-j4vcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 03 20:15:17.550481 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.550445 5024 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c87811f-3f27-4d20-a79a-42434b2598e4-maas-api-service-ca\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:15:17.550481 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:17.550477 5024 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4vcv\" (UniqueName: \"kubernetes.io/projected/7c87811f-3f27-4d20-a79a-42434b2598e4-kube-api-access-j4vcv\") on node \"ip-10-0-131-64.us-west-1.compute.internal\" DevicePath \"\"" Nov 03 20:15:18.193159 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:18.193111 5024 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" event={"ID":"7c87811f-3f27-4d20-a79a-42434b2598e4","Type":"ContainerDied","Data":"13731bcee48f1ac681fa239bf457061f5647db432a62913e0a36bf3d9af46b1f"} Nov 03 20:15:18.193351 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:18.193199 5024 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf" Nov 03 20:15:18.193351 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:18.193220 5024 scope.go:122] "RemoveContainer" containerID="6e803853c32190668b5687cb30ae2a4bb8acfbe3f1e82c75ecdd737655973883" Nov 03 20:15:18.373147 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:18.373111 5024 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf"] Nov 03 20:15:18.422907 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:18.422874 5024 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29895615-6sxjf"] Nov 03 20:15:19.556608 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:19.556578 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t69kp_aa187bc7-e39b-4361-9bc4-e484ab7ef1a7/node-exporter/0.log" Nov 03 20:15:19.985649 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:19.985622 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t69kp_aa187bc7-e39b-4361-9bc4-e484ab7ef1a7/kube-rbac-proxy/0.log" Nov 03 20:15:20.335092 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:20.335003 5024 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7c87811f-3f27-4d20-a79a-42434b2598e4" path="/var/lib/kubelet/pods/7c87811f-3f27-4d20-a79a-42434b2598e4/volumes" Nov 03 20:15:20.409786 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:20.409755 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-t69kp_aa187bc7-e39b-4361-9bc4-e484ab7ef1a7/init-textfile/0.log" Nov 03 20:15:20.666137 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:20.666104 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-pdd6r_d1d835fd-33ea-47c0-a306-929c8ac31e13/manager/0.log" Nov 03 20:15:21.364468 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:21.364434 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-85txq_fb726d2e-89ab-4754-af02-537fdea524f3/manager/0.log" Nov 03 20:15:21.774403 ip-10-0-131-64 kubenswrapper[5024]: I1103 20:15:21.774369 5024 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-2sxcf_80170616-a5ce-47e9-bda2-2cd8695aa3f1/manager/0.log"