Nov 02 13:40:23.558025 ip-10-0-134-60 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Nov 02 13:40:23.558042 ip-10-0-134-60 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Nov 02 13:40:23.558052 ip-10-0-134-60 systemd[1]: kubelet.service: Failed with result 'resources'. Nov 02 13:40:23.558427 ip-10-0-134-60 systemd[1]: Failed to start Kubernetes Kubelet. Nov 02 13:40:33.564882 ip-10-0-134-60 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Nov 02 13:40:33.564896 ip-10-0-134-60 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot fbfaa231d2094120b31da9bd927a44b9 -- Nov 02 13:42:19.100832 ip-10-0-134-60 systemd[1]: Starting Kubernetes Kubelet... Nov 02 13:42:19.558981 ip-10-0-134-60 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 13:42:19.558981 ip-10-0-134-60 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 02 13:42:19.558981 ip-10-0-134-60 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 13:42:19.558981 ip-10-0-134-60 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 13:42:19.563507 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563331 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.563507 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563504 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.563507 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563511 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.563507 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563514 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563518 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563521 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563524 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563526 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563529 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563545 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563549 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563552 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563555 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563559 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563562 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563565 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563568 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563571 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563573 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563576 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563580 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563583 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563586 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.563714 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563588 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563591 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563593 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563596 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563599 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563601 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563604 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563606 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563608 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563617 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563619 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563622 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563625 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563629 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563631 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563635 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563638 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563640 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563643 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.564189 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563645 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563648 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563651 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563653 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563656 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563658 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563661 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563664 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563667 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563669 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563672 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563675 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563677 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563680 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563682 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563685 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563687 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563692 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563695 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563698 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.564654 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563700 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563703 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563706 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563709 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563711 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563715 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563718 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563721 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563724 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563729 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563733 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563737 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563739 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563742 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563744 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563747 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563750 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563753 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563755 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.565118 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563758 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563760 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563770 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563773 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563776 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563779 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563781 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563784 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563787 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563789 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563791 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563794 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563796 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563799 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563801 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563804 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563806 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563810 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563814 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563817 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.565580 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563820 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563822 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563825 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563827 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.563830 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564751 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564760 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564763 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564766 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564769 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564771 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564774 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564777 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564779 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564782 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564791 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564794 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564796 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564799 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.566076 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564802 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564807 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564811 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564813 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564816 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564819 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564821 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564824 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564826 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564829 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564831 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564834 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564837 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564840 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564842 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564845 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564848 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564851 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564853 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564856 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.566547 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564858 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564861 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564863 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564865 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564868 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564870 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564873 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564875 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564877 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564886 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564888 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564891 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564893 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564896 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564899 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564901 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564904 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564906 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564908 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564911 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.567028 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564913 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564916 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564918 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564921 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564925 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564927 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564939 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564942 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564947 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564950 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564953 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564956 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564958 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564961 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564964 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564966 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564968 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564971 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564973 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.567500 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564976 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564978 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564981 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564985 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564987 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564990 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564992 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564995 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.564997 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565000 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565002 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565005 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565007 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565010 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565012 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565015 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565017 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565020 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565023 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565025 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.567986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565028 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565031 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565033 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565036 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565038 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565041 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565043 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565046 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565049 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565052 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565054 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565057 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565059 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565645 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565654 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565657 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565660 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565663 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565666 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.568446 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565670 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565673 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565675 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565678 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565681 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565683 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565686 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565688 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565691 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565694 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565697 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565701 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565706 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565709 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565712 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565715 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565717 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565720 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565722 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.568916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565725 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565727 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565730 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565732 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565735 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565737 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565740 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565742 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565745 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565748 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565751 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565753 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565756 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565758 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565761 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565763 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565769 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565772 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565774 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565777 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.569511 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565779 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565782 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565784 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565787 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565791 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565795 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565799 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565802 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565804 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565808 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565811 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565813 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565816 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565818 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565821 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565823 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565826 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565828 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565831 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565833 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.570002 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565836 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565838 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565841 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565844 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565846 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565849 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565852 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565854 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565859 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565862 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565864 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565867 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565869 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565872 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565875 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565878 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565880 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565883 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565886 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.570463 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565888 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565891 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565893 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565897 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565899 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565902 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565904 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565907 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565909 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565912 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565914 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565917 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565919 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565922 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565924 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565927 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565929 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565932 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565934 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.570963 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565937 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565939 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.565943 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567528 2576 flags.go:64] FLAG: --address="0.0.0.0" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567548 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567555 2576 flags.go:64] FLAG: --anonymous-auth="true" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567560 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567565 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567568 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567572 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567576 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567579 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567582 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567585 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567588 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567592 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567595 2576 flags.go:64] FLAG: --cgroup-root="" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567597 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567600 2576 flags.go:64] FLAG: --client-ca-file="" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567603 2576 flags.go:64] FLAG: --cloud-provider="external" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567606 2576 flags.go:64] FLAG: --cluster-dns="[]" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567610 2576 flags.go:64] FLAG: --cluster-domain="" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567613 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 02 13:42:19.571400 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567616 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567619 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567622 2576 flags.go:64] FLAG: --container-log-max-files="5" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567626 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567629 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567632 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567635 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567643 2576 flags.go:64] FLAG: --contention-profiling="false" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567647 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567650 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567653 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567657 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567665 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567668 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567671 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567674 2576 flags.go:64] FLAG: --enable-load-reader="false" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567677 2576 flags.go:64] FLAG: --enable-server="true" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567680 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567686 2576 flags.go:64] FLAG: --event-burst="100" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567689 2576 flags.go:64] FLAG: --event-qps="50" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567692 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567695 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567698 2576 flags.go:64] FLAG: --eviction-hard="" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567702 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 02 13:42:19.571947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567705 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567708 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567711 2576 flags.go:64] FLAG: --eviction-soft="" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567714 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567716 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567719 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567722 2576 flags.go:64] FLAG: --experimental-mounter-path="" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567725 2576 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567727 2576 flags.go:64] FLAG: --fail-swap-on="true" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567730 2576 flags.go:64] FLAG: --feature-gates="" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567734 2576 flags.go:64] FLAG: --file-check-frequency="20s" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567737 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567740 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567743 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567746 2576 flags.go:64] FLAG: --healthz-port="10248" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567749 2576 flags.go:64] FLAG: --help="false" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567752 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567756 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567759 2576 flags.go:64] FLAG: --http-check-frequency="20s" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567762 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567765 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567768 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567771 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 02 13:42:19.572567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567774 2576 flags.go:64] FLAG: --image-service-endpoint="" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567777 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567780 2576 flags.go:64] FLAG: --kube-api-burst="100" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567783 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567786 2576 flags.go:64] FLAG: --kube-api-qps="50" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567789 2576 flags.go:64] FLAG: --kube-reserved="" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567791 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567794 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567797 2576 flags.go:64] FLAG: --kubelet-cgroups="" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567800 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567802 2576 flags.go:64] FLAG: --lock-file="" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567805 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567808 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567811 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567816 2576 flags.go:64] FLAG: --log-json-split-stream="false" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567819 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567822 2576 flags.go:64] FLAG: --log-text-split-stream="false" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567825 2576 flags.go:64] FLAG: --logging-format="text" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567828 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567831 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567834 2576 flags.go:64] FLAG: --manifest-url="" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567837 2576 flags.go:64] FLAG: --manifest-url-header="" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567841 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567844 2576 flags.go:64] FLAG: --max-open-files="1000000" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567848 2576 flags.go:64] FLAG: --max-pods="110" Nov 02 13:42:19.573124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567850 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567853 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567857 2576 flags.go:64] FLAG: --memory-manager-policy="None" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567860 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567863 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567866 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567869 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567877 2576 flags.go:64] FLAG: --node-status-max-images="50" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567880 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567883 2576 flags.go:64] FLAG: --oom-score-adj="-999" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567886 2576 flags.go:64] FLAG: --pod-cidr="" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567889 2576 flags.go:64] FLAG: --pod-manifest-path="" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567892 2576 flags.go:64] FLAG: --pod-max-pids="-1" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567895 2576 flags.go:64] FLAG: --pods-per-core="0" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567898 2576 flags.go:64] FLAG: --port="10250" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567901 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567903 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0027d1ff2d2a6a232" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567906 2576 flags.go:64] FLAG: --qos-reserved="" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567909 2576 flags.go:64] FLAG: --read-only-port="10255" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567912 2576 flags.go:64] FLAG: --register-node="true" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567915 2576 flags.go:64] FLAG: --register-with-taints="" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567918 2576 flags.go:64] FLAG: --registry-burst="10" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567921 2576 flags.go:64] FLAG: --registry-qps="5" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567924 2576 flags.go:64] FLAG: --reserved-cpus="" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567928 2576 flags.go:64] FLAG: --reserved-memory="" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567932 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 02 13:42:19.573739 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567935 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567938 2576 flags.go:64] FLAG: --rotate-certificates="false" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567941 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567943 2576 flags.go:64] FLAG: --runonce="false" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567946 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567950 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567953 2576 flags.go:64] FLAG: --seccomp-default="false" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567955 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567958 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567962 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567966 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567969 2576 flags.go:64] FLAG: --storage-driver-password="root" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567971 2576 flags.go:64] FLAG: --storage-driver-secure="false" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567974 2576 flags.go:64] FLAG: --storage-driver-table="stats" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567977 2576 flags.go:64] FLAG: --storage-driver-user="root" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567980 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567983 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567986 2576 flags.go:64] FLAG: --system-cgroups="" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567989 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567994 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.567997 2576 flags.go:64] FLAG: --tls-cert-file="" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568000 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568004 2576 flags.go:64] FLAG: --tls-min-version="" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568007 2576 flags.go:64] FLAG: --tls-private-key-file="" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568009 2576 flags.go:64] FLAG: --topology-manager-policy="none" Nov 02 13:42:19.574446 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568012 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568015 2576 flags.go:64] FLAG: --topology-manager-scope="container" Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568018 2576 flags.go:64] FLAG: --v="2" Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568022 2576 flags.go:64] FLAG: --version="false" Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568026 2576 flags.go:64] FLAG: --vmodule="" Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568035 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568038 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568171 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568174 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568178 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568181 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568184 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568186 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568189 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568192 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568195 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568197 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568201 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568204 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568206 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568209 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.575077 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568211 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568214 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568216 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568219 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568222 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568224 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568227 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568229 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568232 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568234 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568237 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568239 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568242 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568244 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568247 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568249 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568253 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568256 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568258 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.575585 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568261 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568263 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568265 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568268 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568270 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568273 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568276 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568279 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568282 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568284 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568287 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568290 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568292 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568295 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568300 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568304 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568307 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568309 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568312 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.576034 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568314 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568317 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568319 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568322 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568324 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568327 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568329 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568331 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568334 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568336 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568340 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568343 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568345 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568347 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568350 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568352 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568355 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568357 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568360 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568364 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.576487 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568366 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568369 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568371 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568374 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568377 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568380 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568382 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568385 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568387 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568390 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568392 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568395 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568397 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568400 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568403 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568406 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568409 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568412 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568415 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.576988 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568417 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568419 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568422 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568425 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568428 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568430 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568433 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568435 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568437 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568440 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568442 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568445 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568449 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568452 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568455 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.568482 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 13:42:19.577425 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568523 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568527 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568545 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568551 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568555 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568558 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568561 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568563 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568566 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568568 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568571 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568574 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568576 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568579 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568581 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568584 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568586 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568588 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568591 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.577815 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568595 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568597 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568600 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568602 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568605 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568607 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568610 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568612 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568615 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568617 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568621 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568624 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568626 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568629 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568632 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568634 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568637 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568640 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568645 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.578249 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568648 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568651 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568653 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568656 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568658 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568661 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568663 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568666 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568668 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568670 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568673 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568675 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568678 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568681 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568684 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568686 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568689 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568692 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568694 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568697 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.578786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568699 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568701 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568704 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568707 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568710 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568712 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568715 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568719 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568721 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568724 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568726 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568729 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568732 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568734 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568737 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568739 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568742 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568744 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568748 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568751 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.579243 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568753 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568756 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568758 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568761 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568763 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568766 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568769 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568771 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568774 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568776 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568779 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568781 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568783 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568786 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568788 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568792 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568794 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568797 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568799 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568801 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.579744 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568804 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568807 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568809 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568812 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568815 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568817 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568820 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.568822 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.576092 2576 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.576106 2576 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.576123 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.576128 2576 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576187 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576192 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576195 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576198 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576201 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576203 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576206 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576209 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.580211 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576212 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576215 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576217 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576220 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576222 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576225 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576227 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576230 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576233 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576237 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576241 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576244 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576247 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576250 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576253 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576256 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576259 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576262 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576265 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.580697 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576267 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576270 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576273 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576276 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576278 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576281 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576284 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576287 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576289 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576292 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576294 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576297 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576301 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576304 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576307 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576310 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576312 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576315 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576317 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.581157 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576320 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576322 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576325 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576327 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576330 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576332 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576335 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576337 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576340 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576342 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576345 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576348 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576350 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576353 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576355 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576358 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576361 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576364 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576366 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.581727 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576369 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576371 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576374 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576376 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576379 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576381 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576384 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576386 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576389 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576391 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576394 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576396 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576399 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576401 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576404 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576406 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576408 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576411 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576414 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576416 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.582160 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576419 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576422 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576424 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576427 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576430 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576432 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576435 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576437 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576441 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576443 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576446 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576448 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576451 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576453 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576455 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576458 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576460 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576462 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576465 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.582639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576467 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576470 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.576498 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576672 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576678 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576681 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576683 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576686 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576689 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576691 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576694 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576697 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576699 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576702 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576704 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.583088 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576707 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576709 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576712 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576715 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576717 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576720 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576724 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576726 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576729 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576731 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576734 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576736 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576739 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576741 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576744 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576747 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576749 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576752 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576754 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576756 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.583494 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576759 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576762 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576765 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576767 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576770 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576772 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576775 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576777 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576779 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576782 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576784 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576787 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576789 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576792 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576794 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.576796 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577161 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577167 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577172 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.583986 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577175 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577178 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577180 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577183 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577185 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577188 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577191 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577193 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577196 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577199 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577201 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577203 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577206 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577208 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577211 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577215 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577218 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577221 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577224 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.584475 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577226 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577229 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577231 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577234 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577236 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577238 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577241 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577244 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577246 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577248 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577251 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577254 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577257 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577259 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577262 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577264 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577266 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577269 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577271 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577275 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.584944 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577277 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577280 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577282 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577284 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577287 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577289 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577291 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577294 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577296 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577299 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577302 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577304 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577307 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577309 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577312 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577314 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.585522 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.577340 2576 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577373 2576 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577377 2576 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577381 2576 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577384 2576 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577387 2576 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577390 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577392 2576 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577395 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577398 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577401 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577403 2576 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577406 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577408 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577411 2576 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577413 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577415 2576 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577418 2576 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577420 2576 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577423 2576 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:42:19.585982 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577425 2576 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577428 2576 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577430 2576 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577433 2576 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577436 2576 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577438 2576 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577442 2576 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577445 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577448 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577451 2576 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577453 2576 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577455 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577458 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577460 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577462 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577465 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577468 2576 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577470 2576 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577473 2576 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:42:19.586454 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577475 2576 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577478 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577481 2576 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577483 2576 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577487 2576 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577491 2576 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577494 2576 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577496 2576 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577499 2576 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577501 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577503 2576 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577506 2576 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577508 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577510 2576 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577513 2576 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577515 2576 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577518 2576 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577520 2576 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577523 2576 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577525 2576 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:42:19.587008 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577528 2576 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577530 2576 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577545 2576 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577548 2576 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577550 2576 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577553 2576 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577555 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577558 2576 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577560 2576 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577563 2576 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577565 2576 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577567 2576 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577570 2576 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577572 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577574 2576 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577577 2576 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577580 2576 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577582 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577585 2576 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577587 2576 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:42:19.587468 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577590 2576 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577592 2576 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577594 2576 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577597 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577599 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577601 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577604 2576 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577609 2576 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577612 2576 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577614 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577616 2576 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577619 2576 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577621 2576 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577624 2576 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577626 2576 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577629 2576 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577631 2576 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577633 2576 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577637 2576 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:42:19.588014 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577639 2576 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577642 2576 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577645 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577648 2576 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577650 2576 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577652 2576 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577655 2576 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577657 2576 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:19.577660 2576 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.577713 2576 server.go:957] "Client rotation is on, will bootstrap in background" Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.583176 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.584132 2576 server.go:1014] "Starting client certificate rotation" Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.584248 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.585129 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 02 13:42:19.588786 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.586718 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 13:42:19.590583 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.590568 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 13:42:19.605140 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.605119 2576 log.go:25] "Validated CRI v1 runtime API" Nov 02 13:42:19.609732 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.609716 2576 log.go:25] "Validated CRI v1 image API" Nov 02 13:42:19.610507 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.610481 2576 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 02 13:42:19.614994 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.614972 2576 fs.go:135] Filesystem UUIDs: map[0b22b95e-c774-4e71-a7fd-f7481ac6628d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9fdb8e05-5feb-464f-beb2-950bc652921c:/dev/nvme0n1p4] Nov 02 13:42:19.615065 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.614995 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}] Nov 02 13:42:19.620164 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.620055 2576 manager.go:217] Machine: {Timestamp:2026-11-02 13:42:19.618725164 +0000 UTC m=+0.381022402 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100903 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26b1bf2134bd98098e89c0101d9657 SystemUUID:ec26b1bf-2134-bd98-098e-89c0101d9657 BootID:fbfaa231-d209-4120-b31d-a9bd927a44b9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cb:e5:6a:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cb:e5:6a:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:9c:2d:32:8c:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 02 13:42:19.620164 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.620164 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 02 13:42:19.620290 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.620278 2576 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 02 13:42:19.622273 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.622257 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 02 13:42:19.623296 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.623267 2576 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 02 13:42:19.623431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.623300 2576 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-60.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 02 13:42:19.624060 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.624050 2576 topology_manager.go:143] "Creating topology manager with none policy" Nov 02 13:42:19.624091 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.624062 2576 container_manager_linux.go:311] "Creating device plugin manager" Nov 02 13:42:19.624123 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.624090 2576 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 13:42:19.624123 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.624103 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 13:42:19.625148 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.625137 2576 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 02 13:42:19.629182 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629170 2576 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 02 13:42:19.629321 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629311 2576 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 02 13:42:19.629350 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629344 2576 kubelet.go:493] "Attempting to sync node with API server" Nov 02 13:42:19.629381 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629358 2576 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 02 13:42:19.629381 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629368 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 02 13:42:19.629381 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629377 2576 kubelet.go:405] "Adding apiserver pod source" Nov 02 13:42:19.629462 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629386 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 02 13:42:19.629795 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.629782 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 13:42:19.632181 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.632163 2576 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 02 13:42:19.639084 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.639068 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 13:42:19.639967 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.639955 2576 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 02 13:42:19.640013 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.639985 2576 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 02 13:42:19.640146 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640135 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 02 13:42:19.640202 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640154 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 02 13:42:19.640202 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640172 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 02 13:42:19.640202 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640178 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 02 13:42:19.640202 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640185 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 02 13:42:19.640202 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640192 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 02 13:42:19.640788 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640776 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 02 13:42:19.640788 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640787 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 02 13:42:19.640860 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640800 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 02 13:42:19.640860 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640807 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 02 13:42:19.640860 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640836 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 02 13:42:19.640860 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.640846 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 02 13:42:19.641580 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.641570 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 02 13:42:19.641580 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.641580 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 02 13:42:19.645546 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.645520 2576 server.go:1263] "Started kubelet" Nov 02 13:42:19.645648 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.645592 2576 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 02 13:42:19.645704 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.645637 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 02 13:42:19.645704 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.645693 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 02 13:42:19.646228 ip-10-0-134-60 systemd[1]: Started Kubernetes Kubelet. Nov 02 13:42:19.647193 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.647126 2576 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 02 13:42:19.648212 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.648199 2576 server.go:317] "Adding debug handlers to kubelet server" Nov 02 13:42:19.651774 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.651753 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-60.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Nov 02 13:42:19.652503 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.652481 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" Nov 02 13:42:19.652594 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.652484 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-60.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" Nov 02 13:42:19.652783 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.652763 2576 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Nov 02 13:42:19.656252 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.656237 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 02 13:42:19.656907 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.656842 2576 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 02 13:42:19.656980 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.656945 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:19.657627 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.657608 2576 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 02 13:42:19.657702 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.657650 2576 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 02 13:42:19.657782 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.657771 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 02 13:42:19.657834 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.657819 2576 reconstruct.go:97] "Volume reconstruction finished" Nov 02 13:42:19.657834 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.657826 2576 reconciler.go:29] "Reconciler: start to sync state" Nov 02 13:42:19.658218 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.658202 2576 factory.go:153] Registering CRI-O factory Nov 02 13:42:19.658271 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.658222 2576 factory.go:223] Registration of the crio container factory successfully Nov 02 13:42:19.658271 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.658268 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 02 13:42:19.658324 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.658276 2576 factory.go:55] Registering systemd factory Nov 02 13:42:19.658324 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.658281 2576 factory.go:223] Registration of the systemd container factory successfully Nov 02 13:42:19.658324 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.658295 2576 factory.go:103] Registering Raw factory Nov 02 13:42:19.658324 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.658303 2576 manager.go:1199] Started watching for new ooms in manager Nov 02 13:42:19.659359 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.659295 2576 manager.go:319] Starting recovery of all containers Nov 02 13:42:19.662135 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.662106 2576 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-60.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Nov 02 13:42:19.663152 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.661864 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-60.us-east-2.compute.internal.18e43e32d523fd1c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-60.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-60.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 13:42:19.645492508 +0000 UTC m=+0.407789746,LastTimestamp:2026-11-02 13:42:19.645492508 +0000 UTC m=+0.407789746,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-60.us-east-2.compute.internal,}" Nov 02 13:42:19.669703 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.669686 2576 manager.go:324] Recovery completed Nov 02 13:42:19.671557 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.671514 2576 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" Nov 02 13:42:19.673825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.673813 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:42:19.675475 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.675451 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:42:19.675582 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.675493 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:42:19.675582 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.675509 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:42:19.676090 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.676075 2576 cpu_manager.go:226] "Starting" policy="none" Nov 02 13:42:19.676090 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.676085 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:42:19.676175 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.676090 2576 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 02 13:42:19.676175 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.676109 2576 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 02 13:42:19.677225 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.677205 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:42:19.677315 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.677266 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:42:19.677315 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.677277 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:42:19.678162 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.678077 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-60.us-east-2.compute.internal.18e43e32d6ed7ec7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-60.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-60.us-east-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-60.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 13:42:19.675475655 +0000 UTC m=+0.437772893,LastTimestamp:2026-11-02 13:42:19.675475655 +0000 UTC m=+0.437772893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-60.us-east-2.compute.internal,}" Nov 02 13:42:19.678443 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.678431 2576 policy_none.go:50] "Start" Nov 02 13:42:19.678495 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.678472 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 02 13:42:19.678495 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.678483 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 02 13:42:19.680611 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.680598 2576 policy_none.go:44] "Start" Nov 02 13:42:19.689197 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.689180 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5tb9h" Nov 02 13:42:19.691416 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.691160 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-60.us-east-2.compute.internal.18e43e32d6eddfa3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-60.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-60.us-east-2.compute.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-60.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 13:42:19.675500451 +0000 UTC m=+0.437797690,LastTimestamp:2026-11-02 13:42:19.675500451 +0000 UTC m=+0.437797690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-60.us-east-2.compute.internal,}" Nov 02 13:42:19.693794 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.693728 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-60.us-east-2.compute.internal.18e43e32d6ee188c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-60.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-60.us-east-2.compute.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-60.us-east-2.compute.internal,},FirstTimestamp:2026-11-02 13:42:19.67551502 +0000 UTC m=+0.437812260,LastTimestamp:2026-11-02 13:42:19.67551502 +0000 UTC m=+0.437812260,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-60.us-east-2.compute.internal,}" Nov 02 13:42:19.699834 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.699810 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5tb9h" Nov 02 13:42:19.716112 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.716085 2576 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 02 13:42:19.727810 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.727789 2576 manager.go:341] "Starting Device Plugin manager" Nov 02 13:42:19.728630 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.728476 2576 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 02 13:42:19.728673 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.728633 2576 server.go:87] "Starting device plugin registration server" Nov 02 13:42:19.728844 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.728834 2576 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 02 13:42:19.728881 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.728845 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 02 13:42:19.728970 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.728953 2576 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 02 13:42:19.729063 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.729045 2576 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 02 13:42:19.729063 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.729059 2576 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 02 13:42:19.729509 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.729490 2576 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 02 13:42:19.729587 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.729558 2576 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:19.794403 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.794367 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 02 13:42:19.796262 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.795721 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 02 13:42:19.796262 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.795742 2576 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 02 13:42:19.796262 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.795766 2576 kubelet.go:2521] "Starting kubelet main sync loop" Nov 02 13:42:19.796262 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.795808 2576 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Nov 02 13:42:19.808438 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.808414 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:19.829494 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.829455 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:42:19.830386 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.830368 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:42:19.830479 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.830406 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:42:19.830479 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.830421 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:42:19.830479 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.830448 2576 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.840389 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.840372 2576 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.840490 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.840399 2576 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-60.us-east-2.compute.internal\": node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:19.877407 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.877384 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:19.896702 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.896679 2576 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal"] Nov 02 13:42:19.896776 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.896739 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:42:19.897657 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.897642 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:42:19.897750 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.897669 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:42:19.897750 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.897681 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:42:19.899866 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.899852 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:42:19.900027 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.900095 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900072 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:42:19.900606 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900589 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:42:19.900606 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900598 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:42:19.900732 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900623 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:42:19.900732 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900634 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:42:19.900732 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900622 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:42:19.900732 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.900703 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:42:19.902707 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.902690 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.902783 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.902719 2576 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:42:19.903441 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.903420 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:42:19.903505 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.903454 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:42:19.903505 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.903469 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:42:19.935068 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.935049 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" node="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.941461 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.941443 2576 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" node="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.960016 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.959996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.960085 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.960021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.960085 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:19.960037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85c2bb7358e6511a88ad994aa6c34739-config\") pod \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"85c2bb7358e6511a88ad994aa6c34739\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:19.978125 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:19.978107 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:20.060825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.060796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85c2bb7358e6511a88ad994aa6c34739-config\") pod \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"85c2bb7358e6511a88ad994aa6c34739\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.060825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.060826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.060983 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.060846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.060983 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.060916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.060983 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.060950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.060983 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.060916 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85c2bb7358e6511a88ad994aa6c34739-config\") pod \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"85c2bb7358e6511a88ad994aa6c34739\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.078940 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.078902 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:20.179778 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.179715 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:20.237945 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.237918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.244808 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.244792 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.280751 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.280721 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:20.381238 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.381202 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:20.481733 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.481658 2576 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:42:20.505073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.505044 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:20.548457 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.548434 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:20.552764 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.552750 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:20.558560 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.558546 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.569651 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.569623 2576 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 13:42:20.570418 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.570405 2576 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.583923 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.583900 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Nov 02 13:42:20.584067 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.584029 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 02 13:42:20.584127 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.584066 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 02 13:42:20.584127 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.584096 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 02 13:42:20.584127 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.584102 2576 kubelet.go:3370] "Failed creating a mirror pod" err="Post \"https://a2a16a09ecc554827bab4d7aefffc7a3-f751b33f3734e270.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/openshift-machine-config-operator/pods\": read tcp 10.0.134.60:60176->16.58.233.130:6443: use of closed network connection" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:42:20.584234 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.584101 2576 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received" Nov 02 13:42:20.630438 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.630414 2576 apiserver.go:52] "Watching apiserver" Nov 02 13:42:20.651174 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.651145 2576 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 02 13:42:20.651431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.651408 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb","openshift-cluster-node-tuning-operator/tuned-lln8x","openshift-dns/node-resolver-vgk6w","openshift-image-registry/node-ca-ks6n4","openshift-multus/network-metrics-daemon-xntmf","openshift-multus/multus-additional-cni-plugins-zwb4b","openshift-multus/multus-bggwr","openshift-network-diagnostics/network-check-target-xkt2c","openshift-ovn-kubernetes/ovnkube-node-wkwtp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal","kube-system/global-pull-secret-syncer-kkccd","kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal","openshift-network-operator/iptables-alerter-r9dn5","kube-system/konnectivity-agent-jz2g5"] Nov 02 13:42:20.653849 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.653830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.655898 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.655874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.657283 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.657269 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Nov 02 13:42:20.659234 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.658260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.659234 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.658774 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 02 13:42:20.659234 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.658885 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-n56j5\"" Nov 02 13:42:20.659234 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.659127 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 02 13:42:20.659573 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.659255 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 02 13:42:20.659573 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.659342 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 02 13:42:20.659761 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.659744 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:20.659878 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.659860 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 02 13:42:20.660714 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.660692 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cfdrs\"" Nov 02 13:42:20.660814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.660723 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 02 13:42:20.660814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.660742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.661660 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.661641 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 02 13:42:20.662180 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.662159 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 02 13:42:20.662275 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.662248 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cmphd\"" Nov 02 13:42:20.663147 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663130 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:20.663243 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.663197 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:20.663767 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663752 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-cni-binary-copy\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.663827 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-netns\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.663827 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-conf-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.663827 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663806 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-multus-certs\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.663953 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7vq4\" (UniqueName: \"kubernetes.io/projected/d3290f58-c76c-4996-8bfa-dc0863a18ad5-kube-api-access-x7vq4\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.663953 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0817ddcd-6f81-4631-a580-bde045d0b712-hosts-file\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.664012 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-system-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664012 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.663995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-daemon-config\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664067 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l97h\" (UniqueName: \"kubernetes.io/projected/025cb66b-ee01-4a6f-9331-167cb5c214dc-kube-api-access-6l97h\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664067 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-socket-dir-parent\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664067 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664060 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-k8s-cni-cncf-io\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664149 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-bin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664149 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-multus\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664149 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-kubelet\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664149 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664135 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-hostroot\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664258 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664179 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-etc-kubernetes\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664258 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3290f58-c76c-4996-8bfa-dc0863a18ad5-iptables-alerter-script\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.664258 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664258 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-cnibin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.664367 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664272 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3290f58-c76c-4996-8bfa-dc0863a18ad5-host-slash\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.664367 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0817ddcd-6f81-4631-a580-bde045d0b712-tmp-dir\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.664367 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.664325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvlhq\" (UniqueName: \"kubernetes.io/projected/0817ddcd-6f81-4631-a580-bde045d0b712-kube-api-access-rvlhq\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.665206 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.665189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.667459 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.667446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.669723 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.669706 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.671928 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.671914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.673560 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.673521 2576 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Nov 02 13:42:20.674237 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.674218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:20.676344 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.676326 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.676437 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.676414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:20.678994 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.678977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:20.679050 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.679030 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:20.698057 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.698039 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-54bjz" Nov 02 13:42:20.705565 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.705498 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 13:37:20 +0000 UTC" deadline="2028-06-21 13:59:37.193115018 +0000 UTC" Nov 02 13:42:20.705565 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.705562 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14328h17m16.487557239s" Nov 02 13:42:20.710388 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.710369 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-54bjz" Nov 02 13:42:20.758558 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.758515 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 02 13:42:20.758765 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.758557 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 02 13:42:20.758765 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.758596 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 02 13:42:20.758765 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.758602 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 02 13:42:20.758921 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.758791 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 02 13:42:20.758921 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.758840 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 02 13:42:20.758921 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.758909 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 02 13:42:20.759248 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.759230 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 02 13:42:20.760155 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.759439 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 02 13:42:20.760155 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.759497 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 02 13:42:20.760155 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.759607 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 02 13:42:20.760340 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760206 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 02 13:42:20.760431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760413 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 02 13:42:20.760527 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760486 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rzz2\"" Nov 02 13:42:20.760737 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760717 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 02 13:42:20.760798 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760756 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 02 13:42:20.760991 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760969 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s2t6n\"" Nov 02 13:42:20.761084 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760971 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tb7ws\"" Nov 02 13:42:20.761139 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.760975 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:20.761195 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.761161 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fbcvm\"" Nov 02 13:42:20.761195 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.761181 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 02 13:42:20.761282 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.761259 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 02 13:42:20.761665 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.761649 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 02 13:42:20.761877 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.761865 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-mlv7f\"" Nov 02 13:42:20.762044 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.762031 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cjbpx\"" Nov 02 13:42:20.764604 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-script-lib\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.764695 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-socket-dir-parent\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.764695 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-multus\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.764802 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-etc-kubernetes\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.764802 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-multus\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.764802 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g8jc\" (UniqueName: \"kubernetes.io/projected/c042d838-3403-46c5-a3af-c86e1702f01d-kube-api-access-9g8jc\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:20.764802 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764753 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-etc-kubernetes\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.764802 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-cnibin\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.764802 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9v6c\" (UniqueName: \"kubernetes.io/projected/c27c165b-51d8-422e-9304-5c9df56cffcd-kube-api-access-l9v6c\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-socket-dir-parent\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-ovn\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysconfig\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764950 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gj8t\" (UniqueName: \"kubernetes.io/projected/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-kube-api-access-7gj8t\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.765014 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.764996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-system-cni-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-systemd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765066 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-kubelet-config\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765091 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfl2t\" (UniqueName: \"kubernetes.io/projected/d54597ed-15b3-4939-a362-3f83728cff0f-kube-api-access-lfl2t\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l97h\" (UniqueName: \"kubernetes.io/projected/025cb66b-ee01-4a6f-9331-167cb5c214dc-kube-api-access-6l97h\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-lib-modules\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765223 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3290f58-c76c-4996-8bfa-dc0863a18ad5-iptables-alerter-script\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765328 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-agent-certs\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:20.765372 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-multus-certs\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-multus-certs\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-modprobe-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-kubernetes\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-system-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765480 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxfjg\" (UniqueName: \"kubernetes.io/projected/1c89710e-5e4b-491c-84be-7da3dd910513-kube-api-access-sxfjg\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-bin\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-k8s-cni-cncf-io\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765569 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-system-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-bin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-bin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-kubelet\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765657 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-kubelet\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-hostroot\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3290f58-c76c-4996-8bfa-dc0863a18ad5-host-slash\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-k8s-cni-cncf-io\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvlhq\" (UniqueName: \"kubernetes.io/projected/0817ddcd-6f81-4631-a580-bde045d0b712-kube-api-access-rvlhq\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.765835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3290f58-c76c-4996-8bfa-dc0863a18ad5-host-slash\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-hostroot\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-env-overrides\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765743 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-log-socket\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0817ddcd-6f81-4631-a580-bde045d0b712-tmp-dir\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765859 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-device-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-conf-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.765990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-conf-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766025 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7vq4\" (UniqueName: \"kubernetes.io/projected/d3290f58-c76c-4996-8bfa-dc0863a18ad5-kube-api-access-x7vq4\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-etc-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-netd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766127 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0817ddcd-6f81-4631-a580-bde045d0b712-tmp-dir\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-config\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-systemd\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.766431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-host\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-etc-tuned\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-kubelet\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-systemd-units\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-var-lib-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766340 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54597ed-15b3-4939-a362-3f83728cff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-conf\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-var-lib-kubelet\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766393 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-tmp\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766431 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-host\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-node-log\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766479 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-sys-fs\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-cnibin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766511 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3290f58-c76c-4996-8bfa-dc0863a18ad5-iptables-alerter-script\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-cnibin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-slash\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.766975 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-netns\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-sys\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766662 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-serviceca\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-konnectivity-ca\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766710 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-dbus\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-cni-binary-copy\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-netns\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766775 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-netns\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766795 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0817ddcd-6f81-4631-a580-bde045d0b712-hosts-file\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-registration-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-run\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766841 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0817ddcd-6f81-4631-a580-bde045d0b712-hosts-file\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scsx9\" (UniqueName: \"kubernetes.io/projected/a985c061-f494-4e9f-998b-d61d83969dd0-kube-api-access-scsx9\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-daemon-config\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766949 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.766978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-socket-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.767490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.767140 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-cni-binary-copy\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.768084 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.767283 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-daemon-config\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.779145 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.779113 2576 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 02 13:42:20.782494 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.782469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvlhq\" (UniqueName: \"kubernetes.io/projected/0817ddcd-6f81-4631-a580-bde045d0b712-kube-api-access-rvlhq\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:20.782619 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.782472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7vq4\" (UniqueName: \"kubernetes.io/projected/d3290f58-c76c-4996-8bfa-dc0863a18ad5-kube-api-access-x7vq4\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:20.782619 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.782513 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l97h\" (UniqueName: \"kubernetes.io/projected/025cb66b-ee01-4a6f-9331-167cb5c214dc-kube-api-access-6l97h\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.867758 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867723 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.867973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-env-overrides\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.867973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-log-socket\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.867973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.867973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:20.867973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-device-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.867973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867933 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.867973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867925 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-log-socket\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867938 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-device-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.867984 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-etc-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-netd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868020 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-etc-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868039 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-config\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-systemd\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868064 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-netd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-host\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-etc-tuned\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-kubelet\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-systemd-units\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-var-lib-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54597ed-15b3-4939-a362-3f83728cff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-conf\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-var-lib-kubelet\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868270 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.868348 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-tmp\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-host\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-var-lib-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-systemd-units\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868350 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-kubelet\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-node-log\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-var-lib-kubelet\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-sys-fs\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-slash\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868436 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-host\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-systemd\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-netns\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868496 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-sys\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-sys-fs\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-serviceca\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.868524 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-slash\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.869020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-konnectivity-ca\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.868613 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs podName:c042d838-3403-46c5-a3af-c86e1702f01d nodeName:}" failed. No retries permitted until 2026-11-02 13:42:21.368599541 +0000 UTC m=+2.130896765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs") pod "network-metrics-daemon-xntmf" (UID: "c042d838-3403-46c5-a3af-c86e1702f01d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868632 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-dbus\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-registration-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-run\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scsx9\" (UniqueName: \"kubernetes.io/projected/a985c061-f494-4e9f-998b-d61d83969dd0-kube-api-access-scsx9\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-conf\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868747 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-socket-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-script-lib\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-sys\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g8jc\" (UniqueName: \"kubernetes.io/projected/c042d838-3403-46c5-a3af-c86e1702f01d-kube-api-access-9g8jc\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-cnibin\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9v6c\" (UniqueName: \"kubernetes.io/projected/c27c165b-51d8-422e-9304-5c9df56cffcd-kube-api-access-l9v6c\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.870092 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-ovn\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868469 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-netns\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868964 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysconfig\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869088 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysconfig\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gj8t\" (UniqueName: \"kubernetes.io/projected/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-kube-api-access-7gj8t\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-system-cni-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869201 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-systemd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868271 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-env-overrides\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.868394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-node-log\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-kubelet-config\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfl2t\" (UniqueName: \"kubernetes.io/projected/d54597ed-15b3-4939-a362-3f83728cff0f-kube-api-access-lfl2t\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-system-cni-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-systemd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.870908 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869419 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-cnibin\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-kubelet-config\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869498 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-lib-modules\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869619 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-lib-modules\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869733 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-host\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869823 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-agent-certs\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-modprobe-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-kubernetes\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869942 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxfjg\" (UniqueName: \"kubernetes.io/projected/1c89710e-5e4b-491c-84be-7da3dd910513-kube-api-access-sxfjg\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.869969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-bin\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870040 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-bin\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-modprobe-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.871697 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-kubernetes\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-config\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-socket-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-konnectivity-ca\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-registration-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.870946 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871049 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-ovn\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871103 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-dbus\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-script-lib\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871236 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871247 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-run\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.871306 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.871352 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret podName:88248243-f1a3-4b12-a156-78be12e1add9 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:21.371338015 +0000 UTC m=+2.133635255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret") pod "global-pull-secret-syncer-kkccd" (UID: "88248243-f1a3-4b12-a156-78be12e1add9") : object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871649 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-serviceca\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.871739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.872417 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.872135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-etc-tuned\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.873329 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.872151 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54597ed-15b3-4939-a362-3f83728cff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.873329 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.873311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-tmp\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.874940 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.874915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-agent-certs\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:20.878221 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.878199 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 13:42:20.878221 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.878221 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 13:42:20.878399 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.878231 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lcbqw for pod openshift-network-diagnostics/network-check-target-xkt2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:20.878399 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:20.878290 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw podName:af544062-fa2e-4ef5-b2c5-a849d8c5c109 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:21.378276745 +0000 UTC m=+2.140573970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lcbqw" (UniqueName: "kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw") pod "network-check-target-xkt2c" (UID: "af544062-fa2e-4ef5-b2c5-a849d8c5c109") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:20.881554 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.881515 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gj8t\" (UniqueName: \"kubernetes.io/projected/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-kube-api-access-7gj8t\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:20.881554 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.881525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g8jc\" (UniqueName: \"kubernetes.io/projected/c042d838-3403-46c5-a3af-c86e1702f01d-kube-api-access-9g8jc\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:20.883983 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.883917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfl2t\" (UniqueName: \"kubernetes.io/projected/d54597ed-15b3-4939-a362-3f83728cff0f-kube-api-access-lfl2t\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:20.883983 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.883934 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scsx9\" (UniqueName: \"kubernetes.io/projected/a985c061-f494-4e9f-998b-d61d83969dd0-kube-api-access-scsx9\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:20.884609 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.884590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9v6c\" (UniqueName: \"kubernetes.io/projected/c27c165b-51d8-422e-9304-5c9df56cffcd-kube-api-access-l9v6c\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:20.885337 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.885306 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxfjg\" (UniqueName: \"kubernetes.io/projected/1c89710e-5e4b-491c-84be-7da3dd910513-kube-api-access-sxfjg\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:20.972430 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:20.972392 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85c2bb7358e6511a88ad994aa6c34739.slice/crio-c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496 WatchSource:0}: Error finding container c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496: Status 404 returned error can't find the container with id c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496 Nov 02 13:42:20.977165 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.977145 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bggwr" Nov 02 13:42:20.978773 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:20.978758 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 13:42:20.982274 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:20.982254 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9bcda821779e795e17c3629099dc04.slice/crio-6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5 WatchSource:0}: Error finding container 6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5: Status 404 returned error can't find the container with id 6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5 Nov 02 13:42:20.986349 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:20.986331 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025cb66b_ee01_4a6f_9331_167cb5c214dc.slice/crio-b8cd0492dcb3f36b67c5c0ca0301c4283e05f1934672b97971411b77a1d73f8b WatchSource:0}: Error finding container b8cd0492dcb3f36b67c5c0ca0301c4283e05f1934672b97971411b77a1d73f8b: Status 404 returned error can't find the container with id b8cd0492dcb3f36b67c5c0ca0301c4283e05f1934672b97971411b77a1d73f8b Nov 02 13:42:21.008939 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.008890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:42:21.017892 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.017871 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3290f58_c76c_4996_8bfa_dc0863a18ad5.slice/crio-f6cec6537ccbf2c9918f137e2e458621d4b3cd5c84db7fea52f0ceec9f049009 WatchSource:0}: Error finding container f6cec6537ccbf2c9918f137e2e458621d4b3cd5c84db7fea52f0ceec9f049009: Status 404 returned error can't find the container with id f6cec6537ccbf2c9918f137e2e458621d4b3cd5c84db7fea52f0ceec9f049009 Nov 02 13:42:21.024187 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.024171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:42:21.030567 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.030527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:42:21.032636 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.032615 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0817ddcd_6f81_4631_a580_bde045d0b712.slice/crio-1cb4dd8cabdd2e8c0a537d4cd57ce97b997bbaf95b551b73d906c023a4e0d9e1 WatchSource:0}: Error finding container 1cb4dd8cabdd2e8c0a537d4cd57ce97b997bbaf95b551b73d906c023a4e0d9e1: Status 404 returned error can't find the container with id 1cb4dd8cabdd2e8c0a537d4cd57ce97b997bbaf95b551b73d906c023a4e0d9e1 Nov 02 13:42:21.038639 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.038620 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ad0bf5_0de3_43dc_b13a_6ef480ff447f.slice/crio-c7b806c991e625d4207b580401678a3224badc07e59afdfc0e07e91da834a68a WatchSource:0}: Error finding container c7b806c991e625d4207b580401678a3224badc07e59afdfc0e07e91da834a68a: Status 404 returned error can't find the container with id c7b806c991e625d4207b580401678a3224badc07e59afdfc0e07e91da834a68a Nov 02 13:42:21.055443 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.055427 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:42:21.064263 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.064243 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c89710e_5e4b_491c_84be_7da3dd910513.slice/crio-75803b147791f845453ca0baa6633ce1a48626787789d20676ac628d3c8c4f24 WatchSource:0}: Error finding container 75803b147791f845453ca0baa6633ce1a48626787789d20676ac628d3c8c4f24: Status 404 returned error can't find the container with id 75803b147791f845453ca0baa6633ce1a48626787789d20676ac628d3c8c4f24 Nov 02 13:42:21.077028 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.077010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:21.082684 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.082669 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:42:21.085942 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.085925 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd54597ed_15b3_4939_a362_3f83728cff0f.slice/crio-de80354d572aab4e4265664586b2cb8d62bda64e08b15d1a60263ce3ec9460f0 WatchSource:0}: Error finding container de80354d572aab4e4265664586b2cb8d62bda64e08b15d1a60263ce3ec9460f0: Status 404 returned error can't find the container with id de80354d572aab4e4265664586b2cb8d62bda64e08b15d1a60263ce3ec9460f0 Nov 02 13:42:21.090333 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.090313 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27c165b_51d8_422e_9304_5c9df56cffcd.slice/crio-961023a26942635ceb96e524f2d00694521f7fb0506c3a1b94055cd00380a6d9 WatchSource:0}: Error finding container 961023a26942635ceb96e524f2d00694521f7fb0506c3a1b94055cd00380a6d9: Status 404 returned error can't find the container with id 961023a26942635ceb96e524f2d00694521f7fb0506c3a1b94055cd00380a6d9 Nov 02 13:42:21.099863 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.099846 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:42:21.104462 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.104447 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:21.108380 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.108360 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda985c061_f494_4e9f_998b_d61d83969dd0.slice/crio-4c61516c9068b966d8a2d0ae691772f114625114182fa850380eac61af33405d WatchSource:0}: Error finding container 4c61516c9068b966d8a2d0ae691772f114625114182fa850380eac61af33405d: Status 404 returned error can't find the container with id 4c61516c9068b966d8a2d0ae691772f114625114182fa850380eac61af33405d Nov 02 13:42:21.112883 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:21.112861 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd039fba_62d0_4a2b_9c86_3bfb0bdd7c9d.slice/crio-2da2c156b66b85fc6cb93cc27d07e3e70eeb06c5c2ecfc9de2c01bde13dccb20 WatchSource:0}: Error finding container 2da2c156b66b85fc6cb93cc27d07e3e70eeb06c5c2ecfc9de2c01bde13dccb20: Status 404 returned error can't find the container with id 2da2c156b66b85fc6cb93cc27d07e3e70eeb06c5c2ecfc9de2c01bde13dccb20 Nov 02 13:42:21.114895 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.114877 2576 kuberuntime_manager.go:1707] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-jz2g5_kube-system(fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Nov 02 13:42:21.114949 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.114905 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-jz2g5" podUID="fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d" Nov 02 13:42:21.374031 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.373953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:21.374031 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.373989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:21.374223 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.374090 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:21.374223 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.374115 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:21.374223 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.374154 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret podName:88248243-f1a3-4b12-a156-78be12e1add9 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:22.374137351 +0000 UTC m=+3.136434598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret") pod "global-pull-secret-syncer-kkccd" (UID: "88248243-f1a3-4b12-a156-78be12e1add9") : object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:21.374223 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.374175 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs podName:c042d838-3403-46c5-a3af-c86e1702f01d nodeName:}" failed. No retries permitted until 2026-11-02 13:42:22.374160259 +0000 UTC m=+3.136457489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs") pod "network-metrics-daemon-xntmf" (UID: "c042d838-3403-46c5-a3af-c86e1702f01d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:21.474696 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.474654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:21.474882 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.474851 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 13:42:21.474958 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.474886 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 13:42:21.474958 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.474902 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lcbqw for pod openshift-network-diagnostics/network-check-target-xkt2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:21.475063 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.474968 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw podName:af544062-fa2e-4ef5-b2c5-a849d8c5c109 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:22.474948171 +0000 UTC m=+3.237245422 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcbqw" (UniqueName: "kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw") pod "network-check-target-xkt2c" (UID: "af544062-fa2e-4ef5-b2c5-a849d8c5c109") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:21.713918 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.713746 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 13:37:21 +0000 UTC" deadline="2028-04-29 15:33:35.564159957 +0000 UTC" Nov 02 13:42:21.713918 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.713816 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13057h51m13.85034806s" Nov 02 13:42:21.799436 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.798746 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:21.799436 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.798881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:21.822700 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.822641 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bggwr" event={"ID":"025cb66b-ee01-4a6f-9331-167cb5c214dc","Type":"ContainerStarted","Data":"b8cd0492dcb3f36b67c5c0ca0301c4283e05f1934672b97971411b77a1d73f8b"} Nov 02 13:42:21.831472 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.831382 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lln8x" event={"ID":"a985c061-f494-4e9f-998b-d61d83969dd0","Type":"ContainerStarted","Data":"4c61516c9068b966d8a2d0ae691772f114625114182fa850380eac61af33405d"} Nov 02 13:42:21.842791 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.842651 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" event={"ID":"c27c165b-51d8-422e-9304-5c9df56cffcd","Type":"ContainerStarted","Data":"961023a26942635ceb96e524f2d00694521f7fb0506c3a1b94055cd00380a6d9"} Nov 02 13:42:21.849279 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.848936 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"de80354d572aab4e4265664586b2cb8d62bda64e08b15d1a60263ce3ec9460f0"} Nov 02 13:42:21.859858 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.859826 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vgk6w" event={"ID":"0817ddcd-6f81-4631-a580-bde045d0b712","Type":"ContainerStarted","Data":"1cb4dd8cabdd2e8c0a537d4cd57ce97b997bbaf95b551b73d906c023a4e0d9e1"} Nov 02 13:42:21.867452 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.867421 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r9dn5" event={"ID":"d3290f58-c76c-4996-8bfa-dc0863a18ad5","Type":"ContainerStarted","Data":"f6cec6537ccbf2c9918f137e2e458621d4b3cd5c84db7fea52f0ceec9f049009"} Nov 02 13:42:21.873445 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.873414 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"af9bcda821779e795e17c3629099dc04","Type":"ContainerStarted","Data":"6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5"} Nov 02 13:42:21.877844 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.877813 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"85c2bb7358e6511a88ad994aa6c34739","Type":"ContainerStarted","Data":"c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496"} Nov 02 13:42:21.883294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.883231 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jz2g5" event={"ID":"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d","Type":"ContainerStarted","Data":"2da2c156b66b85fc6cb93cc27d07e3e70eeb06c5c2ecfc9de2c01bde13dccb20"} Nov 02 13:42:21.889531 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.889504 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerStarted","Data":"75803b147791f845453ca0baa6633ce1a48626787789d20676ac628d3c8c4f24"} Nov 02 13:42:21.891875 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:21.891845 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ef3d8a5c5a290fbfb7b3688e9a224e9c47d9f3326f05a0f73577656437e3f406\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-jz2g5" podUID="fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d" Nov 02 13:42:21.915070 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:21.914944 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ks6n4" event={"ID":"34ad0bf5-0de3-43dc-b13a-6ef480ff447f","Type":"ContainerStarted","Data":"c7b806c991e625d4207b580401678a3224badc07e59afdfc0e07e91da834a68a"} Nov 02 13:42:22.007555 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.007471 2576 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:22.382478 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.382364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:22.382478 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.382421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:22.382744 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.382595 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:22.382744 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.382657 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret podName:88248243-f1a3-4b12-a156-78be12e1add9 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:24.382638458 +0000 UTC m=+5.144935687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret") pod "global-pull-secret-syncer-kkccd" (UID: "88248243-f1a3-4b12-a156-78be12e1add9") : object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:22.383080 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.383056 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:22.383165 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.383114 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs podName:c042d838-3403-46c5-a3af-c86e1702f01d nodeName:}" failed. No retries permitted until 2026-11-02 13:42:24.383099451 +0000 UTC m=+5.145396684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs") pod "network-metrics-daemon-xntmf" (UID: "c042d838-3403-46c5-a3af-c86e1702f01d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:22.482918 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.482875 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:22.483116 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.483058 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 13:42:22.483116 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.483077 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 13:42:22.483116 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.483088 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lcbqw for pod openshift-network-diagnostics/network-check-target-xkt2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:22.483285 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.483143 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw podName:af544062-fa2e-4ef5-b2c5-a849d8c5c109 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:24.48312797 +0000 UTC m=+5.245425224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcbqw" (UniqueName: "kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw") pod "network-check-target-xkt2c" (UID: "af544062-fa2e-4ef5-b2c5-a849d8c5c109") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:22.690611 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.690459 2576 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:22.714094 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.713984 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 13:37:21 +0000 UTC" deadline="2028-06-30 19:29:30.318555759 +0000 UTC" Nov 02 13:42:22.714094 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.714035 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14549h47m7.604525394s" Nov 02 13:42:22.797118 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.796200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:22.797118 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.796368 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:22.797118 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:22.796957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:22.797118 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:22.797064 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:23.538835 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:23.538632 2576 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:23.665312 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:23.665079 2576 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:42:23.799993 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:23.799054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:23.799993 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:23.799194 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:24.404858 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:24.404774 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:24.404858 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:24.404826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:24.405090 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.404971 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:24.405090 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.405029 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret podName:88248243-f1a3-4b12-a156-78be12e1add9 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:28.40501081 +0000 UTC m=+9.167308055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret") pod "global-pull-secret-syncer-kkccd" (UID: "88248243-f1a3-4b12-a156-78be12e1add9") : object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:24.405654 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.405567 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:24.405768 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.405716 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs podName:c042d838-3403-46c5-a3af-c86e1702f01d nodeName:}" failed. No retries permitted until 2026-11-02 13:42:28.40561246 +0000 UTC m=+9.167909703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs") pod "network-metrics-daemon-xntmf" (UID: "c042d838-3403-46c5-a3af-c86e1702f01d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:24.505789 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:24.505513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:24.507005 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.506152 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 13:42:24.507005 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.506180 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 13:42:24.507005 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.506192 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lcbqw for pod openshift-network-diagnostics/network-check-target-xkt2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:24.507005 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.506252 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw podName:af544062-fa2e-4ef5-b2c5-a849d8c5c109 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:28.506234417 +0000 UTC m=+9.268531645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcbqw" (UniqueName: "kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw") pod "network-check-target-xkt2c" (UID: "af544062-fa2e-4ef5-b2c5-a849d8c5c109") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:24.797300 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:24.796499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:24.797300 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.796695 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:24.797300 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:24.797096 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:24.797300 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:24.797198 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:25.805945 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:25.805705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:25.806528 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:25.806040 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:25.950770 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:25.949663 2576 generic.go:356] "Generic (PLEG): container finished" podID="af9bcda821779e795e17c3629099dc04" containerID="83f2bb72b60cea124d10530080a93c5bb6e8d80aa10101773153fff48e9ec2fd" exitCode=0 Nov 02 13:42:25.950770 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:25.949789 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"af9bcda821779e795e17c3629099dc04","Type":"ContainerDied","Data":"83f2bb72b60cea124d10530080a93c5bb6e8d80aa10101773153fff48e9ec2fd"} Nov 02 13:42:25.978938 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:25.978380 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"85c2bb7358e6511a88ad994aa6c34739","Type":"ContainerStarted","Data":"94773be405fd208258e41dec426c484253074217e96146e0b5a3f2f6d7721e12"} Nov 02 13:42:25.984656 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:25.980948 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="a0c45846f4cecdae666f660eca192a903143373d1e11d24d032ac48b63f13a23" exitCode=0 Nov 02 13:42:25.984656 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:25.981013 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerDied","Data":"a0c45846f4cecdae666f660eca192a903143373d1e11d24d032ac48b63f13a23"} Nov 02 13:42:26.033270 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:26.032828 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" podStartSLOduration=5.032807268 podStartE2EDuration="5.032807268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:26.004945098 +0000 UTC m=+6.767242350" watchObservedRunningTime="2026-11-02 13:42:26.032807268 +0000 UTC m=+6.795104521" Nov 02 13:42:26.796903 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:26.796870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:26.797114 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:26.797026 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:26.797192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:26.797115 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:26.797259 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:26.797190 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:26.988607 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:26.988531 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"af9bcda821779e795e17c3629099dc04","Type":"ContainerStarted","Data":"0b6f744d29fbcae7dae644455aa8c468275eb0d86b1d77f8b712e89ced403e4f"} Nov 02 13:42:27.008816 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:27.008754 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" podStartSLOduration=6.008730852 podStartE2EDuration="6.008730852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:27.008003242 +0000 UTC m=+7.770300495" watchObservedRunningTime="2026-11-02 13:42:27.008730852 +0000 UTC m=+7.771028111" Nov 02 13:42:27.800529 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:27.800451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:27.800697 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:27.800588 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:27.994238 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:27.994197 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ks6n4" event={"ID":"34ad0bf5-0de3-43dc-b13a-6ef480ff447f","Type":"ContainerStarted","Data":"3006fc6bc3bf7e11834f015c9bf364e882d9a55828be45b2e85dbe369f34e935"} Nov 02 13:42:28.006564 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:28.005798 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" event={"ID":"c27c165b-51d8-422e-9304-5c9df56cffcd","Type":"ContainerStarted","Data":"d6ba7ffca9be0bc145d29107c20dda9666c2c2ff340628c36bc794b232609117"} Nov 02 13:42:28.020162 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:28.019855 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ks6n4" podStartSLOduration=2.089566205 podStartE2EDuration="8.019836499s" totalImagesPullingTime="5.930270294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:28.018918315 +0000 UTC m=+8.781215564" watchObservedRunningTime="2026-11-02 13:42:28.019836499 +0000 UTC m=+8.782133749" Nov 02 13:42:28.441981 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:28.441937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:28.442162 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:28.441994 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:28.442162 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.442130 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:28.442268 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.442199 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret podName:88248243-f1a3-4b12-a156-78be12e1add9 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:36.442179833 +0000 UTC m=+17.204477082 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret") pod "global-pull-secret-syncer-kkccd" (UID: "88248243-f1a3-4b12-a156-78be12e1add9") : object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:28.442654 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.442633 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:28.442741 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.442689 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs podName:c042d838-3403-46c5-a3af-c86e1702f01d nodeName:}" failed. No retries permitted until 2026-11-02 13:42:36.442674078 +0000 UTC m=+17.204971310 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs") pod "network-metrics-daemon-xntmf" (UID: "c042d838-3403-46c5-a3af-c86e1702f01d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:28.543580 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:28.543458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:28.543799 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.543718 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 13:42:28.543799 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.543743 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 13:42:28.543799 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.543754 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lcbqw for pod openshift-network-diagnostics/network-check-target-xkt2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:28.544016 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.543804 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw podName:af544062-fa2e-4ef5-b2c5-a849d8c5c109 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:36.543790647 +0000 UTC m=+17.306087885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcbqw" (UniqueName: "kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw") pod "network-check-target-xkt2c" (UID: "af544062-fa2e-4ef5-b2c5-a849d8c5c109") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:28.796892 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:28.796273 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:28.796892 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.796393 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:28.796892 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:28.796457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:28.796892 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:28.796509 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:29.092724 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:29.092694 2576 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 02 13:42:29.734278 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:29.734177 2576 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T13:42:29.092720176Z","UUID":"c79bca17-e60a-4c45-ad55-04524929dcbb","Handler":null,"Name":"","Endpoint":""} Nov 02 13:42:29.736432 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:29.736406 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 02 13:42:29.736681 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:29.736439 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 02 13:42:29.796938 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:29.796902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:29.797114 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:29.797012 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:30.012591 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:30.012515 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bggwr" event={"ID":"025cb66b-ee01-4a6f-9331-167cb5c214dc","Type":"ContainerStarted","Data":"87b3ff4a5eeb0bfdcfde934c0767abe72e967bc6f0941e6d1abedd37fb9c7607"} Nov 02 13:42:30.015271 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:30.015237 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" event={"ID":"c27c165b-51d8-422e-9304-5c9df56cffcd","Type":"ContainerStarted","Data":"8d7a866fc5053dafba8ff12222ac83ac4d525efe0c68ca845539e524c987b67a"} Nov 02 13:42:30.796948 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:30.796912 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:30.796948 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:30.796945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:30.797396 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:30.797039 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:30.797396 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:30.797185 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:31.019705 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:31.019618 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="b6e7f954937fe0be49b26db6c32974889e58922cee9d123e9c09d0d619a3724f" exitCode=0 Nov 02 13:42:31.019866 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:31.019718 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerDied","Data":"b6e7f954937fe0be49b26db6c32974889e58922cee9d123e9c09d0d619a3724f"} Nov 02 13:42:31.023621 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:31.023594 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" event={"ID":"c27c165b-51d8-422e-9304-5c9df56cffcd","Type":"ContainerStarted","Data":"a7d2e27f117a0313f6fced9a197a7f512a01f1b1167642ed43192c2cbe31751f"} Nov 02 13:42:31.026472 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:31.026447 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vgk6w" event={"ID":"0817ddcd-6f81-4631-a580-bde045d0b712","Type":"ContainerStarted","Data":"122c75236a053597cbefdbbee0d3d45f9fbbfdd4393cde75320768f1a6c22dee"} Nov 02 13:42:31.048105 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:31.048059 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-bggwr" podStartSLOduration=2.797467444 podStartE2EDuration="11.048043057s" totalImagesPullingTime="8.250575613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:30.034975475 +0000 UTC m=+10.797272723" watchObservedRunningTime="2026-11-02 13:42:31.048043057 +0000 UTC m=+11.810340306" Nov 02 13:42:31.068442 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:31.068403 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" podStartSLOduration=2.320495737 podStartE2EDuration="11.068389591s" totalImagesPullingTime="8.747893854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:31.068378284 +0000 UTC m=+11.830675530" watchObservedRunningTime="2026-11-02 13:42:31.068389591 +0000 UTC m=+11.830686834" Nov 02 13:42:31.797582 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:31.797295 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:31.797950 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:31.797701 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:32.029670 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.029587 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lln8x" event={"ID":"a985c061-f494-4e9f-998b-d61d83969dd0","Type":"ContainerStarted","Data":"eeeba0a271d4f031eac7fe02af5c4393ea2b6e646ea7d873f0c18e3de108b72d"} Nov 02 13:42:32.031212 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.031185 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r9dn5" event={"ID":"d3290f58-c76c-4996-8bfa-dc0863a18ad5","Type":"ContainerStarted","Data":"da27aba6a97c4d61f75d3662c138ed555911d9e7e63f317f051620416d0abb8c"} Nov 02 13:42:32.033616 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.033589 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="8509dbed7fde58d2712ec7d31052297b12ef672153fe402dd72982fec2b1620c" exitCode=0 Nov 02 13:42:32.033740 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.033644 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerDied","Data":"8509dbed7fde58d2712ec7d31052297b12ef672153fe402dd72982fec2b1620c"} Nov 02 13:42:32.059124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.059072 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-vgk6w" podStartSLOduration=3.18652712 podStartE2EDuration="12.059056331s" totalImagesPullingTime="8.872529211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:31.086229273 +0000 UTC m=+11.848526524" watchObservedRunningTime="2026-11-02 13:42:32.059056331 +0000 UTC m=+12.821353591" Nov 02 13:42:32.086396 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.086353 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r9dn5" podStartSLOduration=3.571198637 podStartE2EDuration="12.086338741s" totalImagesPullingTime="8.515140104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:32.086041648 +0000 UTC m=+12.848338895" watchObservedRunningTime="2026-11-02 13:42:32.086338741 +0000 UTC m=+12.848636002" Nov 02 13:42:32.086558 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.086516 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lln8x" podStartSLOduration=1.406643727 podStartE2EDuration="12.086509968s" totalImagesPullingTime="10.679866241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:32.059002405 +0000 UTC m=+12.821299653" watchObservedRunningTime="2026-11-02 13:42:32.086509968 +0000 UTC m=+12.848807239" Nov 02 13:42:32.797029 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.796993 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:32.797201 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:32.797134 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:32.797201 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:32.797190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:32.797327 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:32.797304 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:33.796345 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:33.796316 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:33.797113 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:33.796447 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:34.042415 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:34.042375 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="11981df66f5a81d63f620e327b93fa2fd66287ebc0bdef3ccdcb8da1c7449505" exitCode=0 Nov 02 13:42:34.042617 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:34.042458 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerDied","Data":"11981df66f5a81d63f620e327b93fa2fd66287ebc0bdef3ccdcb8da1c7449505"} Nov 02 13:42:34.796330 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:34.796180 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:34.796330 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:34.796218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:34.797070 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:34.796437 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:34.797230 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:34.797190 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:35.796913 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:35.796654 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:35.797284 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:35.797011 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:36.047652 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.047617 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jz2g5" event={"ID":"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d","Type":"ContainerStarted","Data":"fb73a5a33aa351aade8b729680fe8a60ca17150a8443832cf3a0a7e6a2a13ff2"} Nov 02 13:42:36.065622 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.065577 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jz2g5" podStartSLOduration=1.531051765 podStartE2EDuration="16.065565164s" totalImagesPullingTime="14.534513399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-11-02 13:42:36.06526919 +0000 UTC m=+16.827566437" watchObservedRunningTime="2026-11-02 13:42:36.065565164 +0000 UTC m=+16.827862411" Nov 02 13:42:36.161849 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.161813 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:36.162342 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.162326 2576 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:36.504394 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.504361 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:36.504528 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.504401 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:36.504528 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.504510 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:36.504528 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.504510 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:36.504643 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.504589 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs podName:c042d838-3403-46c5-a3af-c86e1702f01d nodeName:}" failed. No retries permitted until 2026-11-02 13:42:52.504571232 +0000 UTC m=+33.266868472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs") pod "network-metrics-daemon-xntmf" (UID: "c042d838-3403-46c5-a3af-c86e1702f01d") : object "openshift-multus"/"metrics-daemon-secret" not registered Nov 02 13:42:36.504643 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.504612 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret podName:88248243-f1a3-4b12-a156-78be12e1add9 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:52.504603021 +0000 UTC m=+33.266900245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret") pod "global-pull-secret-syncer-kkccd" (UID: "88248243-f1a3-4b12-a156-78be12e1add9") : object "kube-system"/"original-pull-secret" not registered Nov 02 13:42:36.605412 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.605389 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:36.605525 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.605513 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Nov 02 13:42:36.605587 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.605529 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Nov 02 13:42:36.605587 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.605551 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lcbqw for pod openshift-network-diagnostics/network-check-target-xkt2c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:36.605645 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.605596 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw podName:af544062-fa2e-4ef5-b2c5-a849d8c5c109 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:52.605583223 +0000 UTC m=+33.367880448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lcbqw" (UniqueName: "kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw") pod "network-check-target-xkt2c" (UID: "af544062-fa2e-4ef5-b2c5-a849d8c5c109") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Nov 02 13:42:36.796964 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.796930 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:36.797345 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:36.796931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:36.797345 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.797060 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:36.797345 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:36.797114 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:37.051043 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:37.051015 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"13875fdb70d307336ad05762d79bb19f2a45a6f99025268bd17ae2300c9cbec5"} Nov 02 13:42:37.051137 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:37.051088 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"b4aa4e7097e86eadd04440e9c7b1221fce87f749b045d34587f6bc4033cd1816"} Nov 02 13:42:37.053955 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:37.053929 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="3615d588a6ad5ea488a604c6bf226b7cfa6d012c51747fefed9ae49f310f402c" exitCode=0 Nov 02 13:42:37.054042 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:37.054002 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerDied","Data":"3615d588a6ad5ea488a604c6bf226b7cfa6d012c51747fefed9ae49f310f402c"} Nov 02 13:42:37.797203 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:37.797011 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:37.797684 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:37.797281 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:38.058699 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.058610 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"a0d8a97a89459e3cf1c507db414a219113c949a58cf003e63918384c757a1fec"} Nov 02 13:42:38.058699 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.058685 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"c0d4e0f3345438ba1968ccc6bc03d2fc9482ea098068cec09733e176d95b65e4"} Nov 02 13:42:38.058891 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.058727 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"2cbf8cab968234fe35be99fa9bbf397b23f5019c4c764a4d0970f752b6c63007"} Nov 02 13:42:38.058891 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.058759 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"1c4af45a39f6e6aa2121e155c687fb160831dbbd3a7a961491d3f626f2ec283e"} Nov 02 13:42:38.061528 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.061501 2576 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="21eecfee27e9a0bc4fea89a798a6971d4994c8d4b832162505ed0b3055d9e6fe" exitCode=0 Nov 02 13:42:38.061658 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.061564 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerDied","Data":"21eecfee27e9a0bc4fea89a798a6971d4994c8d4b832162505ed0b3055d9e6fe"} Nov 02 13:42:38.061658 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.061592 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 13:42:38.796919 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.796879 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:38.797124 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:38.796914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:38.797124 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:38.796998 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:38.797124 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:38.797111 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:39.067138 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:39.067046 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" event={"ID":"1c89710e-5e4b-491c-84be-7da3dd910513","Type":"ContainerStarted","Data":"354a023a881bfcc33b38213e85832bc2aba236e97aef295a8628a52e093c6fef"} Nov 02 13:42:39.094714 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:39.094664 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zwb4b" podStartSLOduration=7.6013698640000005 podStartE2EDuration="19.094651344s" totalImagesPullingTime="11.49328148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:39.094240073 +0000 UTC m=+19.856537322" watchObservedRunningTime="2026-11-02 13:42:39.094651344 +0000 UTC m=+19.856948590" Nov 02 13:42:39.797358 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:39.797327 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:39.797782 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:39.797410 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:40.072318 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:40.072229 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"ca0627fc343b2e00b746479c71a46c114d7979d9ecc2ce56352ebe97d02af9e7"} Nov 02 13:42:40.796666 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:40.796635 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:40.796666 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:40.796658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:40.796868 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:40.796746 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:40.796900 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:40.796870 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:41.796468 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:41.796394 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:41.797173 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:41.796487 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:42.079988 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:42.079904 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" event={"ID":"d54597ed-15b3-4939-a362-3f83728cff0f","Type":"ContainerStarted","Data":"e5a45f75680c0451e20e0306fb04ac9307c418473a291c906f336975e375b0f8"} Nov 02 13:42:42.080271 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:42.080241 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:42.096475 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:42.096453 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:42.116187 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:42.116142 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" podStartSLOduration=6.278091043 podStartE2EDuration="22.116130749s" totalImagesPullingTime="15.838039706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:42.115627882 +0000 UTC m=+22.877925129" watchObservedRunningTime="2026-11-02 13:42:42.116130749 +0000 UTC m=+22.878427997" Nov 02 13:42:42.796967 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:42.796932 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:42.797470 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:42.796977 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:42.797470 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:42.797076 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:42.797470 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:42.797214 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:43.083359 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.083292 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:43.083490 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.083389 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:43.101142 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.101113 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:42:43.222217 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.222182 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xkt2c"] Nov 02 13:42:43.222373 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.222355 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:43.222476 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:43.222449 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:43.222830 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.222812 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xntmf"] Nov 02 13:42:43.222915 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.222904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:43.223000 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:43.222979 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:43.224401 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.224379 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kkccd"] Nov 02 13:42:43.224496 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:43.224464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:43.224573 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:43.224557 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:44.796991 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:44.796801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:44.797451 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:44.796801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:44.797451 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:44.797099 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:44.797451 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:44.796801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:44.797451 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:44.797145 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:44.797451 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:44.797210 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:45.950294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:45.950264 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:45.950752 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:45.950421 2576 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 13:42:45.950950 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:45.950930 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:42:46.796737 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:46.796701 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:46.796737 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:46.796735 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:46.797000 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:46.796820 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:46.797000 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:46.796875 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:46.797000 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:46.796961 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:46.797129 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:46.797016 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:48.796877 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:48.796843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:48.797284 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:48.796843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:48.797284 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:48.796954 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xntmf" podUID="c042d838-3403-46c5-a3af-c86e1702f01d" Nov 02 13:42:48.797284 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:48.797022 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kkccd" podUID="88248243-f1a3-4b12-a156-78be12e1add9" Nov 02 13:42:48.797284 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:48.796844 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:48.797284 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:48.797086 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xkt2c" podUID="af544062-fa2e-4ef5-b2c5-a849d8c5c109" Nov 02 13:42:50.018421 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.018391 2576 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeReady" Nov 02 13:42:50.018916 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.018530 2576 kubelet_node_status.go:477] "Fast updating node status as it just became ready" Nov 02 13:42:50.058105 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.058071 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4fnbb"] Nov 02 13:42:50.062613 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.062592 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-p4shv"] Nov 02 13:42:50.062817 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.062789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" Nov 02 13:42:50.065815 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.065795 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mvmkl"] Nov 02 13:42:50.065939 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.065918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-p4shv" Nov 02 13:42:50.068862 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.068844 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.071729 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.071703 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55d4868459-8zb5p"] Nov 02 13:42:50.071834 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.071811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" Nov 02 13:42:50.076722 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.076553 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8"] Nov 02 13:42:50.077887 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.077347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.079639 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.079621 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-h9df4"] Nov 02 13:42:50.079774 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.079761 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.082904 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.082874 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dc775dc7d-7bvmj"] Nov 02 13:42:50.082992 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.082976 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.085603 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.085584 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86"] Nov 02 13:42:50.085671 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.085649 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.088686 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.088669 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c"] Nov 02 13:42:50.088814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.088799 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.093179 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.092282 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4fnbb"] Nov 02 13:42:50.093179 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.092315 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8"] Nov 02 13:42:50.094107 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.094090 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 02 13:42:50.094189 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.094175 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 02 13:42:50.094268 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.094252 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.096050 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.095307 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-js5gg"] Nov 02 13:42:50.096050 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.095440 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" Nov 02 13:42:50.096817 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.096782 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s9w2h\"" Nov 02 13:42:50.096930 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.096892 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 02 13:42:50.097017 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.096929 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n87b2\"" Nov 02 13:42:50.097017 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.096967 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 02 13:42:50.097117 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.097069 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 02 13:42:50.097117 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.097098 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 02 13:42:50.097219 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.097199 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zltd8\"" Nov 02 13:42:50.100270 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.100248 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-744d4b8849-b5rwg"] Nov 02 13:42:50.100413 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.100388 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.110144 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.110119 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4"] Nov 02 13:42:50.110406 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.110393 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.124151 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.124126 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-62f4x"] Nov 02 13:42:50.124285 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.124230 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" Nov 02 13:42:50.127505 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.127483 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mvmkl"] Nov 02 13:42:50.127652 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.127518 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm"] Nov 02 13:42:50.127708 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.127658 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:50.129962 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.129945 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5jl7s"] Nov 02 13:42:50.130080 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.130061 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.134883 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.134797 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.135207 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.135167 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-p4shv"] Nov 02 13:42:50.135303 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.135223 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8"] Nov 02 13:42:50.135303 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.135250 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dntcg"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139459 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-h9df4"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139496 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d4868459-8zb5p"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139525 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139581 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139603 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-js5gg"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139621 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dntcg"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139643 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139665 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jl7s"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139685 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-62f4x"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139705 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc775dc7d-7bvmj"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139723 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139744 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4"] Nov 02 13:42:50.140825 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.139831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.142575 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.141982 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-744d4b8849-b5rwg"] Nov 02 13:42:50.171865 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171840 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.171987 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171895 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.171987 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171918 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 02 13:42:50.171987 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171961 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.171987 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171921 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 02 13:42:50.171987 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171961 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.171987 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171918 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.172198 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.171960 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.172198 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.172010 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 02 13:42:50.172198 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.172026 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.172198 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.172044 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.172328 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.172246 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.172328 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.172317 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.175008 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.174987 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.175008 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.174994 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175015 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175045 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175071 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175077 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175103 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175100 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175146 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175163 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175173 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175197 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 02 13:42:50.175223 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.175224 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 02 13:42:50.176933 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.176911 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 02 13:42:50.177072 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.176961 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 02 13:42:50.177072 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.177043 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 02 13:42:50.180229 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.180214 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 02 13:42:50.188020 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.188000 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 02 13:42:50.193302 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193262 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 02 13:42:50.193302 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193280 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 02 13:42:50.193453 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193302 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 02 13:42:50.193453 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193350 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 02 13:42:50.193453 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193386 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 02 13:42:50.193635 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193528 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 02 13:42:50.193635 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193562 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 02 13:42:50.193635 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193603 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 02 13:42:50.193769 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193680 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 02 13:42:50.193944 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193880 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-cw7nr\"" Nov 02 13:42:50.194016 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.193904 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-djs2j\"" Nov 02 13:42:50.194072 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.194041 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-hb687\"" Nov 02 13:42:50.194121 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.194066 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sw4zl\"" Nov 02 13:42:50.194423 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.194400 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4g77\"" Nov 02 13:42:50.195524 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.195496 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 02 13:42:50.196117 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.196100 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 02 13:42:50.203451 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-service-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.203520 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.203520 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-trusted-ca\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.203520 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203495 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/396ce5b5-d0e0-4200-8332-faed8c96a7ae-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.203649 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203609 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxwdg\" (UniqueName: \"kubernetes.io/projected/e6de1ad4-49f8-4b2a-b781-1339bcf825b7-kube-api-access-pxwdg\") pod \"volume-data-source-validator-58c9f5f46d-qw6f8\" (UID: \"e6de1ad4-49f8-4b2a-b781-1339bcf825b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" Nov 02 13:42:50.203649 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.203649 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203643 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz58h\" (UniqueName: \"kubernetes.io/projected/020f9532-0954-430c-b455-024cc6e03be3-kube-api-access-kz58h\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.203731 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203657 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzms\" (UniqueName: \"kubernetes.io/projected/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-kube-api-access-8nzms\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.203731 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd231bc3-ed1b-4516-8327-05de58219655-tmp-dir\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.203731 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-default-certificate\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.203832 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hqb6\" (UniqueName: \"kubernetes.io/projected/708e90f2-a35b-4028-b1e6-8e364d12b86b-kube-api-access-5hqb6\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.203832 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.203832 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:50.203929 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqn5h\" (UniqueName: \"kubernetes.io/projected/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-kube-api-access-xqn5h\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.203929 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203855 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-cert\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.203929 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.203929 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-stats-auth\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.204045 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.203938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.204045 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5jxb\" (UniqueName: \"kubernetes.io/projected/4335741f-3c45-4afb-81af-43c072a64c23-kube-api-access-v5jxb\") pod \"kas-connection-checker-685895c7c9-4fnbb\" (UID: \"4335741f-3c45-4afb-81af-43c072a64c23\") " pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" Nov 02 13:42:50.204099 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.204099 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.204162 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/020f9532-0954-430c-b455-024cc6e03be3-serving-cert\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.204162 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.204162 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68t9l\" (UniqueName: \"kubernetes.io/projected/d99fc9f1-2f2f-4049-81ae-172359417cdc-kube-api-access-68t9l\") pod \"network-check-source-6f78d59f99-lmrl4\" (UID: \"d99fc9f1-2f2f-4049-81ae-172359417cdc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" Nov 02 13:42:50.204300 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204195 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708e90f2-a35b-4028-b1e6-8e364d12b86b-config\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.204300 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.204300 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.204300 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708e90f2-a35b-4028-b1e6-8e364d12b86b-serving-cert\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.204300 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204296 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-tmp\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.204501 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204311 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.204501 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.204501 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204347 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-serving-cert\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.204501 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9lc\" (UniqueName: \"kubernetes.io/projected/dd231bc3-ed1b-4516-8327-05de58219655-kube-api-access-mq9lc\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.204501 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.204501 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd231bc3-ed1b-4516-8327-05de58219655-config-volume\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jjj5\" (UniqueName: \"kubernetes.io/projected/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-kube-api-access-4jjj5\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204581 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnsxj\" (UniqueName: \"kubernetes.io/projected/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda-kube-api-access-cnsxj\") pod \"kas-connection-checker-685895c7c9-p4shv\" (UID: \"4bc533a9-cb34-4ac4-a40d-c32d8cb70eda\") " pod="kube-system/kas-connection-checker-685895c7c9-p4shv" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0108f6ec-1c16-4842-b63b-40b820bb1867-nginx-conf\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204654 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-config\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204684 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69kk\" (UniqueName: \"kubernetes.io/projected/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-kube-api-access-c69kk\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfp6x\" (UniqueName: \"kubernetes.io/projected/ece5836e-24ec-4d8d-b607-0fdd65af45a7-kube-api-access-pfp6x\") pod \"kas-connection-checker-685895c7c9-mvmkl\" (UID: \"ece5836e-24ec-4d8d-b607-0fdd65af45a7\") " pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.204843 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.205126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.205126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204891 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.205126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204914 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccgxh\" (UniqueName: \"kubernetes.io/projected/396ce5b5-d0e0-4200-8332-faed8c96a7ae-kube-api-access-ccgxh\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.205126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.204978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-snapshots\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.205126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.205126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205052 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.205126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.205384 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.205384 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbh4\" (UniqueName: \"kubernetes.io/projected/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-kube-api-access-wjbh4\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.205384 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205194 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4fn\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.205384 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205217 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.205384 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205262 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.205384 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.205293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6f2c\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.305723 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.305644 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqb6\" (UniqueName: \"kubernetes.io/projected/708e90f2-a35b-4028-b1e6-8e364d12b86b-kube-api-access-5hqb6\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.305723 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.305680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.305723 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.305702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:50.305974 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.305794 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 02 13:42:50.305974 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.305831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqn5h\" (UniqueName: \"kubernetes.io/projected/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-kube-api-access-xqn5h\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.305974 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.305851 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert podName:0108f6ec-1c16-4842-b63b-40b820bb1867 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.805830958 +0000 UTC m=+31.568128193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-62f4x" (UID: "0108f6ec-1c16-4842-b63b-40b820bb1867") : secret "networking-console-plugin-cert" not found Nov 02 13:42:50.305974 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.305877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-cert\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.305974 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.305911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.306229 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-stats-auth\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.306229 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.306229 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5jxb\" (UniqueName: \"kubernetes.io/projected/4335741f-3c45-4afb-81af-43c072a64c23-kube-api-access-v5jxb\") pod \"kas-connection-checker-685895c7c9-4fnbb\" (UID: \"4335741f-3c45-4afb-81af-43c072a64c23\") " pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" Nov 02 13:42:50.306229 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306214 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.306426 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306240 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/020f9532-0954-430c-b455-024cc6e03be3-serving-cert\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68t9l\" (UniqueName: \"kubernetes.io/projected/d99fc9f1-2f2f-4049-81ae-172359417cdc-kube-api-access-68t9l\") pod \"network-check-source-6f78d59f99-lmrl4\" (UID: \"d99fc9f1-2f2f-4049-81ae-172359417cdc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306672 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708e90f2-a35b-4028-b1e6-8e364d12b86b-config\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306693 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708e90f2-a35b-4028-b1e6-8e364d12b86b-serving-cert\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-tmp\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306821 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-serving-cert\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9lc\" (UniqueName: \"kubernetes.io/projected/dd231bc3-ed1b-4516-8327-05de58219655-kube-api-access-mq9lc\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306929 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.308192 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306953 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd231bc3-ed1b-4516-8327-05de58219655-config-volume\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306977 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jjj5\" (UniqueName: \"kubernetes.io/projected/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-kube-api-access-4jjj5\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.306998 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsxj\" (UniqueName: \"kubernetes.io/projected/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda-kube-api-access-cnsxj\") pod \"kas-connection-checker-685895c7c9-p4shv\" (UID: \"4bc533a9-cb34-4ac4-a40d-c32d8cb70eda\") " pod="kube-system/kas-connection-checker-685895c7c9-p4shv" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307020 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0108f6ec-1c16-4842-b63b-40b820bb1867-nginx-conf\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-config\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307077 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69kk\" (UniqueName: \"kubernetes.io/projected/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-kube-api-access-c69kk\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfp6x\" (UniqueName: \"kubernetes.io/projected/ece5836e-24ec-4d8d-b607-0fdd65af45a7-kube-api-access-pfp6x\") pod \"kas-connection-checker-685895c7c9-mvmkl\" (UID: \"ece5836e-24ec-4d8d-b607-0fdd65af45a7\") " pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307147 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307175 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgxh\" (UniqueName: \"kubernetes.io/projected/396ce5b5-d0e0-4200-8332-faed8c96a7ae-kube-api-access-ccgxh\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-snapshots\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307280 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307304 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.309073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.307401 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307404 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbh4\" (UniqueName: \"kubernetes.io/projected/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-kube-api-access-wjbh4\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.307414 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4fn\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307559 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6f2c\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-service-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307648 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-trusted-ca\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307704 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/396ce5b5-d0e0-4200-8332-faed8c96a7ae-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307736 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxwdg\" (UniqueName: \"kubernetes.io/projected/e6de1ad4-49f8-4b2a-b781-1339bcf825b7-kube-api-access-pxwdg\") pod \"volume-data-source-validator-58c9f5f46d-qw6f8\" (UID: \"e6de1ad4-49f8-4b2a-b781-1339bcf825b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307947 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz58h\" (UniqueName: \"kubernetes.io/projected/020f9532-0954-430c-b455-024cc6e03be3-kube-api-access-kz58h\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.309814 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.307992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzms\" (UniqueName: \"kubernetes.io/projected/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-kube-api-access-8nzms\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.308041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd231bc3-ed1b-4516-8327-05de58219655-tmp-dir\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308211 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308228 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308289 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.808271596 +0000 UTC m=+31.570568840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308310 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.808298221 +0000 UTC m=+31.570595447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : configmap references non-existent config key: service-ca.crt Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308326 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.808316515 +0000 UTC m=+31.570613773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308342 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308386 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls podName:dd231bc3-ed1b-4516-8327-05de58219655 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.808369186 +0000 UTC m=+31.570666430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls") pod "dns-default-dntcg" (UID: "dd231bc3-ed1b-4516-8327-05de58219655") : secret "dns-default-metrics-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.308340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-tmp\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308466 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.308529 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls podName:3e9ac3c3-9b57-4528-94bd-08d35a0c23ed nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.808511661 +0000 UTC m=+31.570808904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-v6p86" (UID: "3e9ac3c3-9b57-4528-94bd-08d35a0c23ed") : secret "samples-operator-tls" not found Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.309242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-snapshots\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.310325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.310598 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.310473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-default-certificate\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.311271 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.310761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd231bc3-ed1b-4516-8327-05de58219655-tmp-dir\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.311271 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.311038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708e90f2-a35b-4028-b1e6-8e364d12b86b-config\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.311271 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.311053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.311585 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.311327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd231bc3-ed1b-4516-8327-05de58219655-config-volume\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.311585 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.311497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.311754 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.311809 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls podName:396ce5b5-d0e0-4200-8332-faed8c96a7ae nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.811793425 +0000 UTC m=+31.574090650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-pnhbm" (UID: "396ce5b5-d0e0-4200-8332-faed8c96a7ae") : secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.312035 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/396ce5b5-d0e0-4200-8332-faed8c96a7ae-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.312267 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0108f6ec-1c16-4842-b63b-40b820bb1867-nginx-conf\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.312437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-config\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.312466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.312466 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-service-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.312692 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-trusted-ca\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.312864 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.312982 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.313027 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:50.813013844 +0000 UTC m=+31.575311073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/020f9532-0954-430c-b455-024cc6e03be3-serving-cert\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313329 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-serving-cert\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.313958 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.314924 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313558 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.314924 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-cert\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.314924 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.314924 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.314924 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.313964 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-stats-auth\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.315263 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.315244 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708e90f2-a35b-4028-b1e6-8e364d12b86b-serving-cert\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.315810 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.315790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.316085 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.316070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-default-certificate\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.321741 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.321714 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqn5h\" (UniqueName: \"kubernetes.io/projected/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-kube-api-access-xqn5h\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.322107 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.322073 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqb6\" (UniqueName: \"kubernetes.io/projected/708e90f2-a35b-4028-b1e6-8e364d12b86b-kube-api-access-5hqb6\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.322447 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.322421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5jxb\" (UniqueName: \"kubernetes.io/projected/4335741f-3c45-4afb-81af-43c072a64c23-kube-api-access-v5jxb\") pod \"kas-connection-checker-685895c7c9-4fnbb\" (UID: \"4335741f-3c45-4afb-81af-43c072a64c23\") " pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" Nov 02 13:42:50.327828 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.327800 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.327935 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.327893 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9lc\" (UniqueName: \"kubernetes.io/projected/dd231bc3-ed1b-4516-8327-05de58219655-kube-api-access-mq9lc\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.328040 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.328011 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4fn\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.328377 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.328356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68t9l\" (UniqueName: \"kubernetes.io/projected/d99fc9f1-2f2f-4049-81ae-172359417cdc-kube-api-access-68t9l\") pod \"network-check-source-6f78d59f99-lmrl4\" (UID: \"d99fc9f1-2f2f-4049-81ae-172359417cdc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" Nov 02 13:42:50.328970 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.328939 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxwdg\" (UniqueName: \"kubernetes.io/projected/e6de1ad4-49f8-4b2a-b781-1339bcf825b7-kube-api-access-pxwdg\") pod \"volume-data-source-validator-58c9f5f46d-qw6f8\" (UID: \"e6de1ad4-49f8-4b2a-b781-1339bcf825b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" Nov 02 13:42:50.329059 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.328986 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbh4\" (UniqueName: \"kubernetes.io/projected/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-kube-api-access-wjbh4\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.329287 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.329264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgxh\" (UniqueName: \"kubernetes.io/projected/396ce5b5-d0e0-4200-8332-faed8c96a7ae-kube-api-access-ccgxh\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.330214 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.330188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69kk\" (UniqueName: \"kubernetes.io/projected/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-kube-api-access-c69kk\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.330888 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.330871 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6f2c\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.331152 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.331135 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz58h\" (UniqueName: \"kubernetes.io/projected/020f9532-0954-430c-b455-024cc6e03be3-kube-api-access-kz58h\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.337660 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.337630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jjj5\" (UniqueName: \"kubernetes.io/projected/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-kube-api-access-4jjj5\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.337765 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.337740 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnsxj\" (UniqueName: \"kubernetes.io/projected/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda-kube-api-access-cnsxj\") pod \"kas-connection-checker-685895c7c9-p4shv\" (UID: \"4bc533a9-cb34-4ac4-a40d-c32d8cb70eda\") " pod="kube-system/kas-connection-checker-685895c7c9-p4shv" Nov 02 13:42:50.337834 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.337812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzms\" (UniqueName: \"kubernetes.io/projected/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-kube-api-access-8nzms\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.337880 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.337858 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.337911 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.337896 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfp6x\" (UniqueName: \"kubernetes.io/projected/ece5836e-24ec-4d8d-b607-0fdd65af45a7-kube-api-access-pfp6x\") pod \"kas-connection-checker-685895c7c9-mvmkl\" (UID: \"ece5836e-24ec-4d8d-b607-0fdd65af45a7\") " pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" Nov 02 13:42:50.379079 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.379054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" Nov 02 13:42:50.384810 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.384764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-p4shv" Nov 02 13:42:50.390621 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.390604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" Nov 02 13:42:50.425696 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.425659 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:42:50.436698 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.436671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:42:50.462214 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.457016 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:42:50.465878 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.465842 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" Nov 02 13:42:50.475941 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.475916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:42:50.482352 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.482143 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" Nov 02 13:42:50.505981 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.505955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:42:50.688730 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.688700 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-4fnbb"] Nov 02 13:42:50.693068 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.693049 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-p4shv"] Nov 02 13:42:50.693518 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.693496 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-mvmkl"] Nov 02 13:42:50.693845 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.693824 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4335741f_3c45_4afb_81af_43c072a64c23.slice/crio-0235a3d1b286137f236c778147bcac4956329300fdc49a6d2d74422322e8ae4c WatchSource:0}: Error finding container 0235a3d1b286137f236c778147bcac4956329300fdc49a6d2d74422322e8ae4c: Status 404 returned error can't find the container with id 0235a3d1b286137f236c778147bcac4956329300fdc49a6d2d74422322e8ae4c Nov 02 13:42:50.696764 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.696055 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece5836e_24ec_4d8d_b607_0fdd65af45a7.slice/crio-8f0cf0a1ad3ba784ce31898a177ad7ffb3a728b47c5e1daf9f16c11490620532 WatchSource:0}: Error finding container 8f0cf0a1ad3ba784ce31898a177ad7ffb3a728b47c5e1daf9f16c11490620532: Status 404 returned error can't find the container with id 8f0cf0a1ad3ba784ce31898a177ad7ffb3a728b47c5e1daf9f16c11490620532 Nov 02 13:42:50.696952 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.696782 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc533a9_cb34_4ac4_a40d_c32d8cb70eda.slice/crio-0b1cd995b31ca475a5f7cf51b0775bf3fccb2a61e0766794386b59578d5e52ba WatchSource:0}: Error finding container 0b1cd995b31ca475a5f7cf51b0775bf3fccb2a61e0766794386b59578d5e52ba: Status 404 returned error can't find the container with id 0b1cd995b31ca475a5f7cf51b0775bf3fccb2a61e0766794386b59578d5e52ba Nov 02 13:42:50.777338 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.777248 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8"] Nov 02 13:42:50.780549 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.780080 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c"] Nov 02 13:42:50.782812 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.782766 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c05d6ad_1e03_4cf4_9bab_c3a89c8913dd.slice/crio-ddc20af95313ee3e39a8231c663ddf10900bc507d65c4b8fcb61e605284fc1f8 WatchSource:0}: Error finding container ddc20af95313ee3e39a8231c663ddf10900bc507d65c4b8fcb61e605284fc1f8: Status 404 returned error can't find the container with id ddc20af95313ee3e39a8231c663ddf10900bc507d65c4b8fcb61e605284fc1f8 Nov 02 13:42:50.792637 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.792040 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-h9df4"] Nov 02 13:42:50.796000 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.795958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:50.796000 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.795995 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:50.796231 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.796157 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:50.797611 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.797584 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1e1f78_6650_47b7_bd32_33ff5e2ad398.slice/crio-8063e479ce2ad2689787fbc28a7e470c7caca8743bdba45e74bd3adbdb03395d WatchSource:0}: Error finding container 8063e479ce2ad2689787fbc28a7e470c7caca8743bdba45e74bd3adbdb03395d: Status 404 returned error can't find the container with id 8063e479ce2ad2689787fbc28a7e470c7caca8743bdba45e74bd3adbdb03395d Nov 02 13:42:50.804558 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.804525 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 02 13:42:50.804659 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.804582 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qngrq\"" Nov 02 13:42:50.804758 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.804724 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-tzjbd\"" Nov 02 13:42:50.804758 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.804754 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 02 13:42:50.804856 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.804769 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-m5gp5\"" Nov 02 13:42:50.817481 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.817438 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8"] Nov 02 13:42:50.833721 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.833699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:50.833827 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.833742 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:50.833827 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.833767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.833931 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.833849 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:42:50.833931 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.833867 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:50.833931 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.833886 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:42:50.833931 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.833892 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.83388081 +0000 UTC m=+32.596178048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.833941 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.833921851 +0000 UTC m=+32.596219089 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.833966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.833997 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834012 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.834014 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834069 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834096 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834070 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.834039289 +0000 UTC m=+32.596336537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834127 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls podName:396ce5b5-d0e0-4200-8332-faed8c96a7ae nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.834112916 +0000 UTC m=+32.596410143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-pnhbm" (UID: "396ce5b5-d0e0-4200-8332-faed8c96a7ae") : secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:50.834142 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834146 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls podName:3e9ac3c3-9b57-4528-94bd-08d35a0c23ed nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.834138163 +0000 UTC m=+32.596435388 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-v6p86" (UID: "3e9ac3c3-9b57-4528-94bd-08d35a0c23ed") : secret "samples-operator-tls" not found Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.834197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.834216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.834252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834312 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834315 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.8343066 +0000 UTC m=+32.596603856 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : configmap references non-existent config key: service-ca.crt Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834341 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834351 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls podName:dd231bc3-ed1b-4516-8327-05de58219655 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.83434199 +0000 UTC m=+32.596639215 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls") pod "dns-default-dntcg" (UID: "dd231bc3-ed1b-4516-8327-05de58219655") : secret "dns-default-metrics-tls" not found Nov 02 13:42:50.834423 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:50.834372 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert podName:0108f6ec-1c16-4842-b63b-40b820bb1867 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:51.834363458 +0000 UTC m=+32.596660686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-62f4x" (UID: "0108f6ec-1c16-4842-b63b-40b820bb1867") : secret "networking-console-plugin-cert" not found Nov 02 13:42:50.857479 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.857439 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6de1ad4_49f8_4b2a_b781_1339bcf825b7.slice/crio-032ad711fec34f58a6be3f0053cf05bf8a2c65d1b874727922b7c431d05ab8c1 WatchSource:0}: Error finding container 032ad711fec34f58a6be3f0053cf05bf8a2c65d1b874727922b7c431d05ab8c1: Status 404 returned error can't find the container with id 032ad711fec34f58a6be3f0053cf05bf8a2c65d1b874727922b7c431d05ab8c1 Nov 02 13:42:50.868090 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.868069 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jl7s"] Nov 02 13:42:50.870936 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.870682 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d9d21b_0ce4_477e_acd2_a26f2e411b89.slice/crio-ae763da57c12950356e6680caebf76957e8aecefcf26b18694c4ae9cd1ebc092 WatchSource:0}: Error finding container ae763da57c12950356e6680caebf76957e8aecefcf26b18694c4ae9cd1ebc092: Status 404 returned error can't find the container with id ae763da57c12950356e6680caebf76957e8aecefcf26b18694c4ae9cd1ebc092 Nov 02 13:42:50.879892 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.879868 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4"] Nov 02 13:42:50.881408 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:50.881388 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-js5gg"] Nov 02 13:42:50.888929 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.888906 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd99fc9f1_2f2f_4049_81ae_172359417cdc.slice/crio-824727a64b8f32c20b45bd3b9f563d6ee496197e5b84c123223b9fb58b464b05 WatchSource:0}: Error finding container 824727a64b8f32c20b45bd3b9f563d6ee496197e5b84c123223b9fb58b464b05: Status 404 returned error can't find the container with id 824727a64b8f32c20b45bd3b9f563d6ee496197e5b84c123223b9fb58b464b05 Nov 02 13:42:50.889350 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:50.889323 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020f9532_0954_430c_b455_024cc6e03be3.slice/crio-75be28aefedc44de4f24b8b4256bd948c7e2cf10d5d5397ca7823c0cc65dbcf2 WatchSource:0}: Error finding container 75be28aefedc44de4f24b8b4256bd948c7e2cf10d5d5397ca7823c0cc65dbcf2: Status 404 returned error can't find the container with id 75be28aefedc44de4f24b8b4256bd948c7e2cf10d5d5397ca7823c0cc65dbcf2 Nov 02 13:42:51.101565 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.101464 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jl7s" event={"ID":"b3d9d21b-0ce4-477e-acd2-a26f2e411b89","Type":"ContainerStarted","Data":"ae763da57c12950356e6680caebf76957e8aecefcf26b18694c4ae9cd1ebc092"} Nov 02 13:42:51.102521 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.102499 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" event={"ID":"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd","Type":"ContainerStarted","Data":"ddc20af95313ee3e39a8231c663ddf10900bc507d65c4b8fcb61e605284fc1f8"} Nov 02 13:42:51.103590 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.103568 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" event={"ID":"e6de1ad4-49f8-4b2a-b781-1339bcf825b7","Type":"ContainerStarted","Data":"032ad711fec34f58a6be3f0053cf05bf8a2c65d1b874727922b7c431d05ab8c1"} Nov 02 13:42:51.104511 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.104493 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" event={"ID":"708e90f2-a35b-4028-b1e6-8e364d12b86b","Type":"ContainerStarted","Data":"49f9368d242d94a2e1b1b0dc68a7b20ffd0758a22ced96d147c8a890c881cc91"} Nov 02 13:42:51.105735 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.105716 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-p4shv" event={"ID":"4bc533a9-cb34-4ac4-a40d-c32d8cb70eda","Type":"ContainerStarted","Data":"e0dc1cbd44dc9028366eab6dfad2599a613fa8b962556e38d852aec9689c880c"} Nov 02 13:42:51.105805 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.105753 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-p4shv" event={"ID":"4bc533a9-cb34-4ac4-a40d-c32d8cb70eda","Type":"ContainerStarted","Data":"0b1cd995b31ca475a5f7cf51b0775bf3fccb2a61e0766794386b59578d5e52ba"} Nov 02 13:42:51.106866 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.106847 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-js5gg" event={"ID":"020f9532-0954-430c-b455-024cc6e03be3","Type":"ContainerStarted","Data":"75be28aefedc44de4f24b8b4256bd948c7e2cf10d5d5397ca7823c0cc65dbcf2"} Nov 02 13:42:51.107911 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.107890 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" event={"ID":"9f1e1f78-6650-47b7-bd32-33ff5e2ad398","Type":"ContainerStarted","Data":"8063e479ce2ad2689787fbc28a7e470c7caca8743bdba45e74bd3adbdb03395d"} Nov 02 13:42:51.109157 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.109136 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" event={"ID":"ece5836e-24ec-4d8d-b607-0fdd65af45a7","Type":"ContainerStarted","Data":"0031f1b8a7d4c8c9896cb274b632a4212ad809e4df4ba66ae9323ab1fd4d1cf0"} Nov 02 13:42:51.109245 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.109174 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" event={"ID":"ece5836e-24ec-4d8d-b607-0fdd65af45a7","Type":"ContainerStarted","Data":"8f0cf0a1ad3ba784ce31898a177ad7ffb3a728b47c5e1daf9f16c11490620532"} Nov 02 13:42:51.110702 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.110682 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" event={"ID":"4335741f-3c45-4afb-81af-43c072a64c23","Type":"ContainerStarted","Data":"b9c93d1dd841b576e7fc7a41f142e058c581c635e5dbf3569917a3c3c0a57eea"} Nov 02 13:42:51.110798 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.110713 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" event={"ID":"4335741f-3c45-4afb-81af-43c072a64c23","Type":"ContainerStarted","Data":"0235a3d1b286137f236c778147bcac4956329300fdc49a6d2d74422322e8ae4c"} Nov 02 13:42:51.111849 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.111828 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" event={"ID":"d99fc9f1-2f2f-4049-81ae-172359417cdc","Type":"ContainerStarted","Data":"824727a64b8f32c20b45bd3b9f563d6ee496197e5b84c123223b9fb58b464b05"} Nov 02 13:42:51.124520 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.124481 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-p4shv" podStartSLOduration=385.12447194 podStartE2EDuration="6m25.12447194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:51.124136921 +0000 UTC m=+31.886434167" watchObservedRunningTime="2026-11-02 13:42:51.12447194 +0000 UTC m=+31.886769187" Nov 02 13:42:51.144313 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.144265 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" podStartSLOduration=385.14425034 podStartE2EDuration="6m25.14425034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:51.143500493 +0000 UTC m=+31.905797742" watchObservedRunningTime="2026-11-02 13:42:51.14425034 +0000 UTC m=+31.906547588" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.845992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.846053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.846083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.846121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.846183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.846210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.846257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:51.846296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846439 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846452 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846510 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.846493171 +0000 UTC m=+34.608790418 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846633 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846674 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls podName:3e9ac3c3-9b57-4528-94bd-08d35a0c23ed nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.846661903 +0000 UTC m=+34.608959141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-v6p86" (UID: "3e9ac3c3-9b57-4528-94bd-08d35a0c23ed") : secret "samples-operator-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846691 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846733 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846743 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:42:51.846947 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846755 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls podName:dd231bc3-ed1b-4516-8327-05de58219655 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.846737567 +0000 UTC m=+34.609034798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls") pod "dns-default-dntcg" (UID: "dd231bc3-ed1b-4516-8327-05de58219655") : secret "dns-default-metrics-tls" not found Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846773 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.846763463 +0000 UTC m=+34.609060713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846820 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846834 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.846823177 +0000 UTC m=+34.609120402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : configmap references non-existent config key: service-ca.crt Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846853 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.846843557 +0000 UTC m=+34.609140795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846883 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846912 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls podName:396ce5b5-d0e0-4200-8332-faed8c96a7ae nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.846902026 +0000 UTC m=+34.609199257 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-pnhbm" (UID: "396ce5b5-d0e0-4200-8332-faed8c96a7ae") : secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.846963 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 02 13:42:51.847994 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:51.847014 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert podName:0108f6ec-1c16-4842-b63b-40b820bb1867 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:53.84700182 +0000 UTC m=+34.609299048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-62f4x" (UID: "0108f6ec-1c16-4842-b63b-40b820bb1867") : secret "networking-console-plugin-cert" not found Nov 02 13:42:52.555012 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:52.553880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:52.555012 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:52.554019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:42:52.555012 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:52.554169 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Nov 02 13:42:52.555012 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:52.554237 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs podName:c042d838-3403-46c5-a3af-c86e1702f01d nodeName:}" failed. No retries permitted until 2026-11-02 13:43:24.554216966 +0000 UTC m=+65.316514199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs") pod "network-metrics-daemon-xntmf" (UID: "c042d838-3403-46c5-a3af-c86e1702f01d") : secret "metrics-daemon-secret" not found Nov 02 13:42:52.563319 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:52.563252 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:52.655706 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:52.655666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:52.676591 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:52.676564 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:52.745244 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:52.745004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:42:52.761477 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:52.761272 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:42:53.104071 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.103963 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" podStartSLOduration=387.103940185 podStartE2EDuration="6m27.103940185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:36:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:51.163338283 +0000 UTC m=+31.925635531" watchObservedRunningTime="2026-11-02 13:42:53.103940185 +0000 UTC m=+33.866237439" Nov 02 13:42:53.107189 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.107163 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xkt2c"] Nov 02 13:42:53.133431 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.133353 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kkccd"] Nov 02 13:42:53.187627 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:53.187576 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf544062_fa2e_4ef5_b2c5_a849d8c5c109.slice/crio-bd36b88617fdf59b60c45499b66b1149dc7399c7f83445e02ec1997335002f46 WatchSource:0}: Error finding container bd36b88617fdf59b60c45499b66b1149dc7399c7f83445e02ec1997335002f46: Status 404 returned error can't find the container with id bd36b88617fdf59b60c45499b66b1149dc7399c7f83445e02ec1997335002f46 Nov 02 13:42:53.867813 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.867776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.867825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.867848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.867894 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.867913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.867951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.867980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:53.868021 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868143 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868155 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:42:53.868294 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868200 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.868186618 +0000 UTC m=+38.630483856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868550 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868612 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.868594601 +0000 UTC m=+38.630891841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868669 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868703 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls podName:396ce5b5-d0e0-4200-8332-faed8c96a7ae nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.86869215 +0000 UTC m=+38.630989391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-pnhbm" (UID: "396ce5b5-d0e0-4200-8332-faed8c96a7ae") : secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868756 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868785 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls podName:3e9ac3c3-9b57-4528-94bd-08d35a0c23ed nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.868776059 +0000 UTC m=+38.631073300 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-v6p86" (UID: "3e9ac3c3-9b57-4528-94bd-08d35a0c23ed") : secret "samples-operator-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868853 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.868842843 +0000 UTC m=+38.631140087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : configmap references non-existent config key: service-ca.crt Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868908 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868936 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls podName:dd231bc3-ed1b-4516-8327-05de58219655 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.868926434 +0000 UTC m=+38.631223674 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls") pod "dns-default-dntcg" (UID: "dd231bc3-ed1b-4516-8327-05de58219655") : secret "dns-default-metrics-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.868990 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.869019 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert podName:0108f6ec-1c16-4842-b63b-40b820bb1867 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.869009465 +0000 UTC m=+38.631306695 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-62f4x" (UID: "0108f6ec-1c16-4842-b63b-40b820bb1867") : secret "networking-console-plugin-cert" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.869064 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.869072 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:42:53.880474 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:53.869091 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:57.86908517 +0000 UTC m=+38.631382395 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:42:54.134073 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:54.133899 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kkccd" event={"ID":"88248243-f1a3-4b12-a156-78be12e1add9","Type":"ContainerStarted","Data":"2d0c4630abd73bce9b34583fbe9c36a0a7c2da02d992df51a16ef6f475f775e3"} Nov 02 13:42:54.140122 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:54.140078 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" event={"ID":"e6de1ad4-49f8-4b2a-b781-1339bcf825b7","Type":"ContainerStarted","Data":"50dfd15455f07a275c03e67f8a83f7796722e807721c55aee7b7fd1150c19294"} Nov 02 13:42:54.143423 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:54.143393 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xkt2c" event={"ID":"af544062-fa2e-4ef5-b2c5-a849d8c5c109","Type":"ContainerStarted","Data":"bd36b88617fdf59b60c45499b66b1149dc7399c7f83445e02ec1997335002f46"} Nov 02 13:42:57.174136 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.173318 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" event={"ID":"708e90f2-a35b-4028-b1e6-8e364d12b86b","Type":"ContainerStarted","Data":"f15399ffcc531a230bcb6c0341fd77b85be83992cad03060a42d2934338079a6"} Nov 02 13:42:57.181154 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.180589 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-js5gg" event={"ID":"020f9532-0954-430c-b455-024cc6e03be3","Type":"ContainerStarted","Data":"66d98b1f2eb7fa8aee106713c5d4af2ca7e8e9ab98ce18d1de78b03299c3807d"} Nov 02 13:42:57.185882 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.185139 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/0.log" Nov 02 13:42:57.185882 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.185176 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" containerID="db307f3aea8d039ffb4262e16a281f13f56a86006fd57501b33dad47e1c57b90" exitCode=255 Nov 02 13:42:57.185882 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.185275 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" event={"ID":"9f1e1f78-6650-47b7-bd32-33ff5e2ad398","Type":"ContainerDied","Data":"db307f3aea8d039ffb4262e16a281f13f56a86006fd57501b33dad47e1c57b90"} Nov 02 13:42:57.185882 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.185601 2576 scope.go:122] "RemoveContainer" containerID="db307f3aea8d039ffb4262e16a281f13f56a86006fd57501b33dad47e1c57b90" Nov 02 13:42:57.190476 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.190400 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jl7s" event={"ID":"b3d9d21b-0ce4-477e-acd2-a26f2e411b89","Type":"ContainerStarted","Data":"e25613e1119826923782a2872057eed1ef7dcd6c5187a01b628bd86fa881873b"} Nov 02 13:42:57.200639 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.196955 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" podStartSLOduration=356.831801054 podStartE2EDuration="6m2.196942184s" totalImagesPullingTime="5.36514113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:57.195741831 +0000 UTC m=+37.958039063" watchObservedRunningTime="2026-11-02 13:42:57.196942184 +0000 UTC m=+37.959239460" Nov 02 13:42:57.200639 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.197034 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" podStartSLOduration=380.840936327 podStartE2EDuration="6m23.197028098s" totalImagesPullingTime="2.356091771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:54.160957934 +0000 UTC m=+34.923255199" watchObservedRunningTime="2026-11-02 13:42:57.197028098 +0000 UTC m=+37.959325344" Nov 02 13:42:57.202627 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.202042 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" event={"ID":"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd","Type":"ContainerStarted","Data":"d2243f9e42a6cbff1452305f60b3fbc790964e901de5ee965893c9819f99198a"} Nov 02 13:42:57.225354 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.224712 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-js5gg" podStartSLOduration=376.511310992 podStartE2EDuration="6m22.224692717s" totalImagesPullingTime="5.713381725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:36:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:57.223276584 +0000 UTC m=+37.985573835" watchObservedRunningTime="2026-11-02 13:42:57.224692717 +0000 UTC m=+37.986989965" Nov 02 13:42:57.308770 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.308547 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5jl7s" podStartSLOduration=1.221933909 podStartE2EDuration="7.308510932s" totalImagesPullingTime="6.086577023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:57.306720021 +0000 UTC m=+38.069017266" watchObservedRunningTime="2026-11-02 13:42:57.308510932 +0000 UTC m=+38.070808171" Nov 02 13:42:57.327501 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.327315 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" podStartSLOduration=356.969886198 podStartE2EDuration="6m2.327299678s" totalImagesPullingTime="5.35741348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:57.325514057 +0000 UTC m=+38.087811306" watchObservedRunningTime="2026-11-02 13:42:57.327299678 +0000 UTC m=+38.089596925" Nov 02 13:42:57.487657 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.486890 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k7fhx"] Nov 02 13:42:57.498483 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.498446 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-lc2vm-gwwjm"] Nov 02 13:42:57.498660 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.498600 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.508425 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.508363 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 02 13:42:57.508425 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.508384 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 02 13:42:57.508684 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.508665 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-clq6z\"" Nov 02 13:42:57.508973 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.508955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.510316 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.510295 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k7fhx"] Nov 02 13:42:57.512438 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.512328 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-lc2vm-gwwjm"] Nov 02 13:42:57.512698 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.512683 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bscj4\"" Nov 02 13:42:57.523926 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.523926 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8011c9f0-6ebd-4e37-8500-ebf56305e263-crio-socket\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.523926 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.523926 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8011c9f0-6ebd-4e37-8500-ebf56305e263-data-volume\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.523926 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523775 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhtqt\" (UniqueName: \"kubernetes.io/projected/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-api-access-lhtqt\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.523926 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mprs\" (UniqueName: \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.523926 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.524335 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.523990 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.524335 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.524075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.612052 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.612018 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-82f9w"] Nov 02 13:42:57.625076 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.625799 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.625930 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8011c9f0-6ebd-4e37-8500-ebf56305e263-crio-socket\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.625930 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.625930 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8011c9f0-6ebd-4e37-8500-ebf56305e263-data-volume\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.625930 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhtqt\" (UniqueName: \"kubernetes.io/projected/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-api-access-lhtqt\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.626145 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mprs\" (UniqueName: \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.626145 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.625990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.626145 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.626013 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.626145 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.626049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.626525 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.626496 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8011c9f0-6ebd-4e37-8500-ebf56305e263-data-volume\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.626986 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.626965 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8011c9f0-6ebd-4e37-8500-ebf56305e263-crio-socket\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.627075 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.627010 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-82f9w"] Nov 02 13:42:57.627140 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.627114 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:42:57.627194 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.627166 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:58.127148011 +0000 UTC m=+38.889445249 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:42:57.627377 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.627358 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 02 13:42:57.627467 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.627405 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:58.127393627 +0000 UTC m=+38.889690852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : configmap "kube-rbac-proxy" not found Nov 02 13:42:57.627467 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.627431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.627806 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.627786 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.628003 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.627975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.629886 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.629651 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6w4xj\"" Nov 02 13:42:57.629886 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.629671 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 02 13:42:57.629886 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.629693 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 02 13:42:57.629886 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.629805 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 02 13:42:57.629886 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.629832 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 02 13:42:57.642934 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.642887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mprs\" (UniqueName: \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.652204 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.652179 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhtqt\" (UniqueName: \"kubernetes.io/projected/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-api-access-lhtqt\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:57.727104 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.727064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-key\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.727273 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.727159 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb5zd\" (UniqueName: \"kubernetes.io/projected/4a8d8d3d-560d-4bf0-8160-b18403d85942-kube-api-access-xb5zd\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.727386 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.727301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-cabundle\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.765126 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.765054 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n"] Nov 02 13:42:57.778173 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.778141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" Nov 02 13:42:57.778949 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.778917 2576 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf"] Nov 02 13:42:57.786784 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.786696 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 02 13:42:57.786784 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.786738 2576 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5vdjw\"" Nov 02 13:42:57.786962 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.786827 2576 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 02 13:42:57.789909 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.789887 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n"] Nov 02 13:42:57.790031 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.790012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" Nov 02 13:42:57.794460 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.794437 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf"] Nov 02 13:42:57.829052 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.828529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sk2t\" (UniqueName: \"kubernetes.io/projected/79880279-3cc7-450e-b2f1-e52a527be2c0-kube-api-access-8sk2t\") pod \"migrator-66df5d496b-x46vf\" (UID: \"79880279-3cc7-450e-b2f1-e52a527be2c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" Nov 02 13:42:57.829052 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.828690 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlqh7\" (UniqueName: \"kubernetes.io/projected/19ea4ba3-7292-4f14-8c78-77cf3cebd95c-kube-api-access-dlqh7\") pod \"migrator-66df5d496b-mq26n\" (UID: \"19ea4ba3-7292-4f14-8c78-77cf3cebd95c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" Nov 02 13:42:57.829052 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.828779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-cabundle\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.829052 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.828858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-key\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.829052 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.828948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5zd\" (UniqueName: \"kubernetes.io/projected/4a8d8d3d-560d-4bf0-8160-b18403d85942-kube-api-access-xb5zd\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.830988 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.830960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-cabundle\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.832831 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.832804 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-key\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.845337 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.845286 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5zd\" (UniqueName: \"kubernetes.io/projected/4a8d8d3d-560d-4bf0-8160-b18403d85942-kube-api-access-xb5zd\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:57.878204 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.878174 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:42:57.930135 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930107 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:57.930308 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930164 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:42:57.930308 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:42:57.930308 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930272 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:42:57.930308 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930300 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930275072 +0000 UTC m=+46.692572314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : configmap references non-existent config key: service-ca.crt Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930317 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930338 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930349 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930378 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls podName:dd231bc3-ed1b-4516-8327-05de58219655 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930363583 +0000 UTC m=+46.692660827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls") pod "dns-default-dntcg" (UID: "dd231bc3-ed1b-4516-8327-05de58219655") : secret "dns-default-metrics-tls" not found Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930419 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930440 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930429721 +0000 UTC m=+46.692726946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sk2t\" (UniqueName: \"kubernetes.io/projected/79880279-3cc7-450e-b2f1-e52a527be2c0-kube-api-access-8sk2t\") pod \"migrator-66df5d496b-x46vf\" (UID: \"79880279-3cc7-450e-b2f1-e52a527be2c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930463 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert podName:0108f6ec-1c16-4842-b63b-40b820bb1867 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930453246 +0000 UTC m=+46.692750490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-62f4x" (UID: "0108f6ec-1c16-4842-b63b-40b820bb1867") : secret "networking-console-plugin-cert" not found Nov 02 13:42:57.930518 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlqh7\" (UniqueName: \"kubernetes.io/projected/19ea4ba3-7292-4f14-8c78-77cf3cebd95c-kube-api-access-dlqh7\") pod \"migrator-66df5d496b-mq26n\" (UID: \"19ea4ba3-7292-4f14-8c78-77cf3cebd95c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930578 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.930616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930732 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930745 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930757 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930768 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls podName:3e9ac3c3-9b57-4528-94bd-08d35a0c23ed nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930756219 +0000 UTC m=+46.693053459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-v6p86" (UID: "3e9ac3c3-9b57-4528-94bd-08d35a0c23ed") : secret "samples-operator-tls" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930789 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930778523 +0000 UTC m=+46.693075753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930807 2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930815 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930842 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930830177 +0000 UTC m=+46.693127402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:42:57.931007 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:57.930860 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls podName:396ce5b5-d0e0-4200-8332-faed8c96a7ae nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.930850428 +0000 UTC m=+46.693147658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-pnhbm" (UID: "396ce5b5-d0e0-4200-8332-faed8c96a7ae") : secret "cluster-monitoring-operator-tls" not found Nov 02 13:42:57.944047 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.944019 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sk2t\" (UniqueName: \"kubernetes.io/projected/79880279-3cc7-450e-b2f1-e52a527be2c0-kube-api-access-8sk2t\") pod \"migrator-66df5d496b-x46vf\" (UID: \"79880279-3cc7-450e-b2f1-e52a527be2c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" Nov 02 13:42:57.948794 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.948764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlqh7\" (UniqueName: \"kubernetes.io/projected/19ea4ba3-7292-4f14-8c78-77cf3cebd95c-kube-api-access-dlqh7\") pod \"migrator-66df5d496b-mq26n\" (UID: \"19ea4ba3-7292-4f14-8c78-77cf3cebd95c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" Nov 02 13:42:57.956816 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:57.956795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:42:58.110024 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.109823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" Nov 02 13:42:58.128108 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.128067 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" Nov 02 13:42:58.132743 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.132718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:58.132912 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.132827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:58.132912 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:58.132887 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:42:58.133026 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:58.132936 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 02 13:42:58.133026 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:58.132966 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:59.132944883 +0000 UTC m=+39.895242126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:42:58.133026 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:58.132989 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:42:59.132974474 +0000 UTC m=+39.895271713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : configmap "kube-rbac-proxy" not found Nov 02 13:42:58.214898 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.214871 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-lc2vm-gwwjm"] Nov 02 13:42:58.218815 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.218788 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" event={"ID":"d99fc9f1-2f2f-4049-81ae-172359417cdc","Type":"ContainerStarted","Data":"7ea3f02216751613aee2497ee382696d17308137107a1bac2203e3aa08fc6ef6"} Nov 02 13:42:58.221267 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.221246 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:42:58.221652 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.221637 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/0.log" Nov 02 13:42:58.221727 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.221665 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" containerID="1b830d2c560302488607ce97a7b5b02daeb56a1b3a1edab8c5e4e9ea96bb2fe8" exitCode=255 Nov 02 13:42:58.224385 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.222414 2576 scope.go:122] "RemoveContainer" containerID="1b830d2c560302488607ce97a7b5b02daeb56a1b3a1edab8c5e4e9ea96bb2fe8" Nov 02 13:42:58.225968 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:58.225929 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-h9df4_openshift-console-operator(9f1e1f78-6650-47b7-bd32-33ff5e2ad398)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" podUID="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" Nov 02 13:42:58.226114 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.225987 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" event={"ID":"9f1e1f78-6650-47b7-bd32-33ff5e2ad398","Type":"ContainerDied","Data":"1b830d2c560302488607ce97a7b5b02daeb56a1b3a1edab8c5e4e9ea96bb2fe8"} Nov 02 13:42:58.226114 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.226028 2576 scope.go:122] "RemoveContainer" containerID="db307f3aea8d039ffb4262e16a281f13f56a86006fd57501b33dad47e1c57b90" Nov 02 13:42:58.228718 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:58.228693 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abda0cb_8e51_4003_942e_27eb6bf88e92.slice/crio-ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d WatchSource:0}: Error finding container ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d: Status 404 returned error can't find the container with id ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d Nov 02 13:42:58.245910 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.245856 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" podStartSLOduration=347.196486793 podStartE2EDuration="5m54.245839079s" totalImagesPullingTime="7.049352286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:58.244609686 +0000 UTC m=+39.006906951" watchObservedRunningTime="2026-11-02 13:42:58.245839079 +0000 UTC m=+39.008136327" Nov 02 13:42:58.282488 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.282180 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-82f9w"] Nov 02 13:42:58.290916 ip-10-0-134-60 kubenswrapper[2576]: W1102 13:42:58.290862 2576 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8d8d3d_560d_4bf0_8160_b18403d85942.slice/crio-05afe1c4a0c8df966c00b908dc39494e743da9c83dc5ec1acc69a89a507d4e0d WatchSource:0}: Error finding container 05afe1c4a0c8df966c00b908dc39494e743da9c83dc5ec1acc69a89a507d4e0d: Status 404 returned error can't find the container with id 05afe1c4a0c8df966c00b908dc39494e743da9c83dc5ec1acc69a89a507d4e0d Nov 02 13:42:58.422472 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.422442 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n"] Nov 02 13:42:58.468865 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:58.468837 2576 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf"] Nov 02 13:42:59.146436 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.146266 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:59.146436 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:59.146372 2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Nov 02 13:42:59.146436 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:59.146431 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:01.146417166 +0000 UTC m=+41.908714395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : configmap "kube-rbac-proxy" not found Nov 02 13:42:59.146746 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.146463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:42:59.146746 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:59.146588 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:42:59.146746 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:59.146618 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:01.146610307 +0000 UTC m=+41.908907556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:42:59.232473 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.232446 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" event={"ID":"79880279-3cc7-450e-b2f1-e52a527be2c0","Type":"ContainerStarted","Data":"26498859fce7ce4e924e4d31af8766a65eec87a37a46a93a3358dc7347abedac"} Nov 02 13:42:59.236608 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.236578 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" event={"ID":"4a8d8d3d-560d-4bf0-8160-b18403d85942","Type":"ContainerStarted","Data":"f12265bab6aa9801cb9c205a791f5e5a58d95fb34c103bb3980521e68692c3cf"} Nov 02 13:42:59.236719 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.236634 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" event={"ID":"4a8d8d3d-560d-4bf0-8160-b18403d85942","Type":"ContainerStarted","Data":"05afe1c4a0c8df966c00b908dc39494e743da9c83dc5ec1acc69a89a507d4e0d"} Nov 02 13:42:59.243933 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.239906 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:42:59.243933 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.240296 2576 scope.go:122] "RemoveContainer" containerID="1b830d2c560302488607ce97a7b5b02daeb56a1b3a1edab8c5e4e9ea96bb2fe8" Nov 02 13:42:59.243933 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:42:59.241794 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-h9df4_openshift-console-operator(9f1e1f78-6650-47b7-bd32-33ff5e2ad398)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" podUID="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" Nov 02 13:42:59.245088 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.245063 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" event={"ID":"2abda0cb-8e51-4003-942e-27eb6bf88e92","Type":"ContainerStarted","Data":"6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae"} Nov 02 13:42:59.245189 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.245110 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" event={"ID":"2abda0cb-8e51-4003-942e-27eb6bf88e92","Type":"ContainerStarted","Data":"ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d"} Nov 02 13:42:59.248804 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.248770 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" event={"ID":"19ea4ba3-7292-4f14-8c78-77cf3cebd95c","Type":"ContainerStarted","Data":"3fee6a6f7ee36fd24261b7e28af753b2af9ef7d13aae9ce2da5e7664036c09d2"} Nov 02 13:42:59.263779 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.263727 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" podStartSLOduration=2.263705973 podStartE2EDuration="2.263705973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:59.26299309 +0000 UTC m=+40.025290338" watchObservedRunningTime="2026-11-02 13:42:59.263705973 +0000 UTC m=+40.026003222" Nov 02 13:42:59.310312 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:42:59.310251 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" podStartSLOduration=2.310232607 podStartE2EDuration="2.310232607s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:42:59.307713379 +0000 UTC m=+40.070010627" watchObservedRunningTime="2026-11-02 13:42:59.310232607 +0000 UTC m=+40.072529922" Nov 02 13:43:00.255876 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:00.255832 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xkt2c" event={"ID":"af544062-fa2e-4ef5-b2c5-a849d8c5c109","Type":"ContainerStarted","Data":"aecc2dae32247c1abe9107fb45af5525f917c05491162edd316b81ade4817f47"} Nov 02 13:43:00.278575 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:00.278065 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xkt2c" podStartSLOduration=34.27051301 podStartE2EDuration="40.278048822s" totalImagesPullingTime="6.007535812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:00.277002135 +0000 UTC m=+41.039299386" watchObservedRunningTime="2026-11-02 13:43:00.278048822 +0000 UTC m=+41.040346069" Nov 02 13:43:00.437703 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:00.437668 2576 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:00.437864 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:00.437736 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:00.438164 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:00.438149 2576 scope.go:122] "RemoveContainer" containerID="1b830d2c560302488607ce97a7b5b02daeb56a1b3a1edab8c5e4e9ea96bb2fe8" Nov 02 13:43:00.438373 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:43:00.438347 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-h9df4_openshift-console-operator(9f1e1f78-6650-47b7-bd32-33ff5e2ad398)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" podUID="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" Nov 02 13:43:00.644394 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:00.644311 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vgk6w_0817ddcd-6f81-4631-a580-bde045d0b712/dns-node-resolver/0.log" Nov 02 13:43:01.184985 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.184910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:01.185133 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.185037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:01.185689 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:43:01.185210 2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:43:01.185689 ip-10-0-134-60 kubenswrapper[2576]: E1102 13:43:01.185296 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:05.185276776 +0000 UTC m=+45.947574014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:43:01.185689 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.185574 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:01.261141 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.261107 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" event={"ID":"19ea4ba3-7292-4f14-8c78-77cf3cebd95c","Type":"ContainerStarted","Data":"d0dbe86a7fea801e3cbcb7fee002f1ceb1799f02f198d27b13f9f960b101b035"} Nov 02 13:43:01.262775 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.262749 2576 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" event={"ID":"79880279-3cc7-450e-b2f1-e52a527be2c0","Type":"ContainerStarted","Data":"3d1bb585a7eb97d0ad924773f7cf49b4a0b22c34261c337c86c6864452d52666"} Nov 02 13:43:01.262976 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.262959 2576 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:43:01.281694 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.281651 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" podStartSLOduration=1.858647068 podStartE2EDuration="4.281636815s" totalImagesPullingTime="2.422989747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:01.280612353 +0000 UTC m=+42.042909601" watchObservedRunningTime="2026-11-02 13:43:01.281636815 +0000 UTC m=+42.043934061" Nov 02 13:43:01.298493 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.298443 2576 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" podStartSLOduration=1.9067225030000001 podStartE2EDuration="4.298430432s" totalImagesPullingTime="2.391707929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:01.297814635 +0000 UTC m=+42.060111861" watchObservedRunningTime="2026-11-02 13:43:01.298430432 +0000 UTC m=+42.060727679" Nov 02 13:43:01.662695 ip-10-0-134-60 kubenswrapper[2576]: I1102 13:43:01.662671 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ks6n4_34ad0bf5-0de3-43dc-b13a-6ef480ff447f/node-ca/0.log" Nov 02 13:43:01.947614 ip-10-0-134-60 systemd[1]: Stopping Kubernetes Kubelet... Nov 02 13:43:01.959081 ip-10-0-134-60 systemd[1]: kubelet.service: Deactivated successfully. Nov 02 13:43:01.959259 ip-10-0-134-60 systemd[1]: Stopped Kubernetes Kubelet. Nov 02 13:43:01.959309 ip-10-0-134-60 systemd[1]: kubelet.service: Consumed 3.332s CPU time. Nov 02 13:43:01.975076 ip-10-0-134-60 systemd[1]: Starting Kubernetes Kubelet... Nov 02 13:43:02.050760 ip-10-0-134-60 kubenswrapper[5081]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 13:43:02.050760 ip-10-0-134-60 kubenswrapper[5081]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Nov 02 13:43:02.050760 ip-10-0-134-60 kubenswrapper[5081]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 13:43:02.050760 ip-10-0-134-60 kubenswrapper[5081]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Nov 02 13:43:02.052901 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052807 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.052901 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052901 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.052901 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052904 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052908 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052911 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052914 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052917 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052921 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052926 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052928 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052931 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052934 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052937 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052945 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052948 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052951 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052954 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052956 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052959 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052961 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052964 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.053003 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052967 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052970 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052972 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052975 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052977 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052980 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052982 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052985 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052988 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052990 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052993 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052996 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.052999 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053001 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053004 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053007 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053010 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053013 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053016 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053018 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.053735 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053021 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053023 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053026 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053028 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053031 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053034 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053037 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053039 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053042 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053044 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053047 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053050 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053052 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053056 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053059 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053061 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053064 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053066 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.054244 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053069 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053073 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053077 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053079 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053082 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053084 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053087 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053092 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053095 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053098 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053100 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053103 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053106 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053109 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053111 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053114 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053116 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053119 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053121 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.054711 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053123 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053127 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053130 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053132 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053135 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053137 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053140 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053143 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053145 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053147 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053150 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053152 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053155 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053157 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053160 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053162 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053165 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053167 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053170 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053172 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.055177 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053176 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053180 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053182 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053185 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053187 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053190 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053193 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.053196 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054078 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054087 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054090 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054093 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054096 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054099 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054108 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054110 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054113 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054116 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054119 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054121 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.055721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054124 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054126 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054129 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054131 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054134 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054137 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054139 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054142 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054144 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054147 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054150 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054152 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054157 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054161 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054163 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054166 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054168 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054171 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054174 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.056207 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054176 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054178 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054181 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054184 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054186 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054189 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054191 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054194 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054201 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054204 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054207 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054210 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054212 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054215 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054218 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054220 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054223 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054225 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054228 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.056755 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054230 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054232 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054235 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054237 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054239 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054242 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054246 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054250 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054253 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054256 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054258 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054261 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054264 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054266 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054268 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054271 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054273 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054277 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054281 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.057211 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054284 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054287 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054290 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054298 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054301 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054303 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054306 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054308 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054311 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054313 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054315 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054318 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054320 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054323 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054325 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054327 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054330 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054332 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054335 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054338 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.057703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054341 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054344 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054346 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054349 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054351 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054353 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054356 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054360 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054363 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054365 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054368 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054371 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054373 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054375 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054379 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054381 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054390 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054928 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054935 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.058215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054938 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054940 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054943 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054946 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054948 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054951 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054954 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054957 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054959 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054962 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054964 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054968 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054971 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054974 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054977 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054979 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054982 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054985 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054987 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054990 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.058692 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054992 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054995 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.054997 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055000 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055002 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055005 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055007 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055010 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055013 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055016 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055019 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055021 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055024 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055026 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055028 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055031 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055034 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055037 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055039 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.059215 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055042 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055044 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055048 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055052 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055055 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055058 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055061 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055064 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055068 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055072 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055075 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055078 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055080 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055083 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055085 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055088 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055090 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055092 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055095 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.059701 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055097 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055100 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055102 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055105 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055108 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055110 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055113 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055115 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055118 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055120 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055123 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055125 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055127 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055130 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055132 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055134 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055137 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055139 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055142 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055144 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.060167 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055147 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055150 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055152 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055154 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055157 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055159 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055163 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055166 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055168 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055171 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055173 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055176 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055179 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055181 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055185 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055188 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055190 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055194 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055196 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055199 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055201 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.060684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055204 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055206 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055209 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055211 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.055214 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055311 5081 flags.go:64] FLAG: --address="0.0.0.0" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055320 5081 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055329 5081 flags.go:64] FLAG: --anonymous-auth="true" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055336 5081 flags.go:64] FLAG: --application-metrics-count-limit="100" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055343 5081 flags.go:64] FLAG: --authentication-token-webhook="false" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055346 5081 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055351 5081 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055355 5081 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055358 5081 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055361 5081 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055364 5081 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055368 5081 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055372 5081 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055375 5081 flags.go:64] FLAG: --cgroup-root="" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055378 5081 flags.go:64] FLAG: --cgroups-per-qos="true" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055381 5081 flags.go:64] FLAG: --client-ca-file="" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055384 5081 flags.go:64] FLAG: --cloud-provider="external" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055387 5081 flags.go:64] FLAG: --cluster-dns="[]" Nov 02 13:43:02.061191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055398 5081 flags.go:64] FLAG: --cluster-domain="" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055401 5081 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055404 5081 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055408 5081 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055411 5081 flags.go:64] FLAG: --container-log-max-files="5" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055420 5081 flags.go:64] FLAG: --container-log-max-size="10Mi" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055423 5081 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055426 5081 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055430 5081 flags.go:64] FLAG: --containerd-namespace="k8s.io" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055433 5081 flags.go:64] FLAG: --contention-profiling="false" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055436 5081 flags.go:64] FLAG: --cpu-cfs-quota="true" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055438 5081 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055441 5081 flags.go:64] FLAG: --cpu-manager-policy="none" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055444 5081 flags.go:64] FLAG: --cpu-manager-policy-options="" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055448 5081 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055451 5081 flags.go:64] FLAG: --enable-controller-attach-detach="true" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055454 5081 flags.go:64] FLAG: --enable-debugging-handlers="true" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055457 5081 flags.go:64] FLAG: --enable-load-reader="false" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055460 5081 flags.go:64] FLAG: --enable-server="true" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055463 5081 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055467 5081 flags.go:64] FLAG: --event-burst="100" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055471 5081 flags.go:64] FLAG: --event-qps="50" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055474 5081 flags.go:64] FLAG: --event-storage-age-limit="default=0" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055477 5081 flags.go:64] FLAG: --event-storage-event-limit="default=0" Nov 02 13:43:02.061920 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055480 5081 flags.go:64] FLAG: --eviction-hard="" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055484 5081 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055490 5081 flags.go:64] FLAG: --eviction-minimum-reclaim="" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055493 5081 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055496 5081 flags.go:64] FLAG: --eviction-soft="" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055498 5081 flags.go:64] FLAG: --eviction-soft-grace-period="" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055501 5081 flags.go:64] FLAG: --exit-on-lock-contention="false" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055504 5081 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055507 5081 flags.go:64] FLAG: --experimental-mounter-path="" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055510 5081 flags.go:64] FLAG: --fail-cgroupv1="true" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055515 5081 flags.go:64] FLAG: --fail-swap-on="true" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055518 5081 flags.go:64] FLAG: --feature-gates="" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055522 5081 flags.go:64] FLAG: --file-check-frequency="20s" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055525 5081 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055528 5081 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055555 5081 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055559 5081 flags.go:64] FLAG: --healthz-port="10248" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055563 5081 flags.go:64] FLAG: --help="false" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055565 5081 flags.go:64] FLAG: --hostname-override="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055569 5081 flags.go:64] FLAG: --housekeeping-interval="10s" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055572 5081 flags.go:64] FLAG: --http-check-frequency="20s" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055574 5081 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055578 5081 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Nov 02 13:43:02.062896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055581 5081 flags.go:64] FLAG: --image-gc-high-threshold="85" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055584 5081 flags.go:64] FLAG: --image-gc-low-threshold="80" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055587 5081 flags.go:64] FLAG: --image-service-endpoint="" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055589 5081 flags.go:64] FLAG: --kernel-memcg-notification="false" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055592 5081 flags.go:64] FLAG: --kube-api-burst="100" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055595 5081 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055598 5081 flags.go:64] FLAG: --kube-api-qps="50" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055603 5081 flags.go:64] FLAG: --kube-reserved="" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055607 5081 flags.go:64] FLAG: --kube-reserved-cgroup="" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055612 5081 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055617 5081 flags.go:64] FLAG: --kubelet-cgroups="" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055622 5081 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055627 5081 flags.go:64] FLAG: --lock-file="" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055631 5081 flags.go:64] FLAG: --log-cadvisor-usage="false" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055636 5081 flags.go:64] FLAG: --log-flush-frequency="5s" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055641 5081 flags.go:64] FLAG: --log-json-info-buffer-size="0" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055650 5081 flags.go:64] FLAG: --log-json-split-stream="false" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055655 5081 flags.go:64] FLAG: --log-text-info-buffer-size="0" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055660 5081 flags.go:64] FLAG: --log-text-split-stream="false" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055666 5081 flags.go:64] FLAG: --logging-format="text" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055669 5081 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055672 5081 flags.go:64] FLAG: --make-iptables-util-chains="true" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055675 5081 flags.go:64] FLAG: --manifest-url="" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055678 5081 flags.go:64] FLAG: --manifest-url-header="" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055683 5081 flags.go:64] FLAG: --max-housekeeping-interval="15s" Nov 02 13:43:02.063599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055686 5081 flags.go:64] FLAG: --max-open-files="1000000" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055690 5081 flags.go:64] FLAG: --max-pods="110" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055693 5081 flags.go:64] FLAG: --maximum-dead-containers="-1" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055696 5081 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055699 5081 flags.go:64] FLAG: --memory-manager-policy="None" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055702 5081 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055705 5081 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055708 5081 flags.go:64] FLAG: --node-ip="0.0.0.0" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055711 5081 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055718 5081 flags.go:64] FLAG: --node-status-max-images="50" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055721 5081 flags.go:64] FLAG: --node-status-update-frequency="10s" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055724 5081 flags.go:64] FLAG: --oom-score-adj="-999" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055727 5081 flags.go:64] FLAG: --pod-cidr="" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055730 5081 flags.go:64] FLAG: --pod-manifest-path="" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055734 5081 flags.go:64] FLAG: --pod-max-pids="-1" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055737 5081 flags.go:64] FLAG: --pods-per-core="0" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055740 5081 flags.go:64] FLAG: --port="10250" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055743 5081 flags.go:64] FLAG: --protect-kernel-defaults="false" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055748 5081 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-0027d1ff2d2a6a232" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055751 5081 flags.go:64] FLAG: --qos-reserved="" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055754 5081 flags.go:64] FLAG: --read-only-port="10255" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055757 5081 flags.go:64] FLAG: --register-node="true" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055760 5081 flags.go:64] FLAG: --register-with-taints="" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055764 5081 flags.go:64] FLAG: --registry-burst="10" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055766 5081 flags.go:64] FLAG: --registry-qps="5" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055769 5081 flags.go:64] FLAG: --reserved-cpus="" Nov 02 13:43:02.064214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055774 5081 flags.go:64] FLAG: --reserved-memory="" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055778 5081 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055781 5081 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055784 5081 flags.go:64] FLAG: --rotate-certificates="false" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055787 5081 flags.go:64] FLAG: --rotate-server-certificates="false" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055790 5081 flags.go:64] FLAG: --runonce="false" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055793 5081 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055796 5081 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055799 5081 flags.go:64] FLAG: --seccomp-default="false" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055802 5081 flags.go:64] FLAG: --serialize-image-pulls="true" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055805 5081 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055808 5081 flags.go:64] FLAG: --storage-driver-db="cadvisor" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055811 5081 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055814 5081 flags.go:64] FLAG: --storage-driver-password="root" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055817 5081 flags.go:64] FLAG: --storage-driver-secure="false" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055819 5081 flags.go:64] FLAG: --storage-driver-table="stats" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055822 5081 flags.go:64] FLAG: --storage-driver-user="root" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055825 5081 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055828 5081 flags.go:64] FLAG: --sync-frequency="1m0s" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055832 5081 flags.go:64] FLAG: --system-cgroups="" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055834 5081 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055839 5081 flags.go:64] FLAG: --system-reserved-cgroup="" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055842 5081 flags.go:64] FLAG: --tls-cert-file="" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055845 5081 flags.go:64] FLAG: --tls-cipher-suites="[]" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055851 5081 flags.go:64] FLAG: --tls-min-version="" Nov 02 13:43:02.064865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055854 5081 flags.go:64] FLAG: --tls-private-key-file="" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055857 5081 flags.go:64] FLAG: --topology-manager-policy="none" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055860 5081 flags.go:64] FLAG: --topology-manager-policy-options="" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055863 5081 flags.go:64] FLAG: --topology-manager-scope="container" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055866 5081 flags.go:64] FLAG: --v="2" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055870 5081 flags.go:64] FLAG: --version="false" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055874 5081 flags.go:64] FLAG: --vmodule="" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055879 5081 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.055883 5081 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056027 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056031 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056034 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056037 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056040 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056042 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056046 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056048 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056051 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056053 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056056 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056058 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.065567 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056061 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056063 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056068 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056071 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056074 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056076 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056079 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056081 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056084 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056087 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056091 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056094 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056096 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056099 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056101 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056103 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056106 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056108 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056112 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056114 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.066129 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056117 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056119 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056122 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056124 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056127 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056129 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056132 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056135 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056138 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056140 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056142 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056145 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056147 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056150 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056152 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056157 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056160 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056163 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056166 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.066624 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056168 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056171 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056173 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056177 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056180 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056182 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056185 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056187 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056190 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056192 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056195 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056198 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056201 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056204 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056206 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056208 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056211 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056214 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056216 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056219 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.067093 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056221 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056224 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056227 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056230 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056232 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056235 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056237 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056240 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056242 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056244 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056247 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056249 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056252 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056254 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056257 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056260 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056263 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056266 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056270 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.067604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056272 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056275 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056278 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056280 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056284 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056287 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056289 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056291 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056294 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056296 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056299 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056301 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056304 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056306 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056309 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056311 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.068104 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.056339 5081 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056388 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056393 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056396 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056399 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056402 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056404 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056407 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056409 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056412 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056414 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056417 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056419 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056427 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056431 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056433 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056437 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056440 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056443 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.068590 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056445 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056450 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056452 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056455 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056457 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056460 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056462 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056465 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056468 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056470 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056473 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056476 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056478 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056481 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056484 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056487 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056489 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056492 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056494 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056496 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.069173 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056499 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056501 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056504 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056506 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056509 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056511 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056514 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056517 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056519 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056522 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056524 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056527 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056545 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056551 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056555 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056560 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056565 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056569 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.069889 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056574 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056578 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056582 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056585 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056588 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056590 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056593 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056595 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056599 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056602 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056604 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056607 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056609 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056612 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056614 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056617 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056619 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056622 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056624 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056628 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.070324 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056631 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056634 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056637 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056639 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056642 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056644 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056647 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056651 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056653 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056656 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056658 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056661 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056663 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056666 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056668 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056670 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056673 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056675 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056678 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056680 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.071055 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056683 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056686 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056688 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056691 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056693 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056695 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056698 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056700 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056703 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.056705 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.061061 5081 server.go:525] "Kubelet version" kubeletVersion="v1.35.9" Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.061077 5081 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.061097 5081 watchdog_linux.go:95] "Systemd watchdog is not enabled" Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.061101 5081 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061171 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061176 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061179 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061182 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061185 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.071696 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061188 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061190 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061193 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061195 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061199 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061202 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061204 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061207 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061211 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061215 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061218 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061220 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061223 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061226 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061228 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061231 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061234 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061243 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061246 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.072160 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061249 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061252 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061256 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061259 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061262 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061265 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061267 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061270 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061273 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061275 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061278 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061280 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061283 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061286 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061288 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061291 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061293 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061296 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061298 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.072640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061301 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061303 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061306 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061308 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061311 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061313 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061316 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061318 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061321 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061323 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061326 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061329 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061337 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061340 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061343 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061346 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061348 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061350 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061353 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061355 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.073094 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061358 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061361 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061364 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061366 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061368 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061371 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061374 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061376 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061379 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061381 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061384 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061386 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061389 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061391 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061394 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061396 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061398 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061401 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061404 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061406 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.073684 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061408 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061411 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061414 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061417 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061419 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061469 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061745 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061752 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061757 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061762 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061767 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061772 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061777 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061781 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061785 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061790 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061795 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061806 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061810 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.074168 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061814 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061818 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061822 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.061827 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.061900 5081 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062824 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062841 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062845 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062850 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062854 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062858 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062862 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062866 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062870 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062876 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062880 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.074640 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062885 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062889 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062898 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.062981 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063007 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063013 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063019 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063024 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063076 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063193 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063204 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063208 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063211 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063214 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063218 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063221 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063223 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063226 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063229 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063231 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.075018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063242 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063246 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063249 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063252 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063255 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063257 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063260 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063263 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063266 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063269 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063271 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063274 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063277 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063279 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063282 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063285 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063288 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063291 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063294 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.075604 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063296 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063299 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063302 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063305 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063307 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063310 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063312 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063315 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063318 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063321 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063323 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063326 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063328 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063331 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063334 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063336 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063339 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063341 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063343 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063346 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.076099 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063349 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063352 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063354 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063357 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063360 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063364 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063369 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063372 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063375 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063378 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063381 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063386 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063388 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063391 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063393 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063396 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063399 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063402 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063404 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.076621 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063407 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063410 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063413 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063415 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063418 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063420 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063423 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063425 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063428 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063431 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063434 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063436 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063439 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063441 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063445 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063449 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.077144 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063452 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.063489 5081 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]} Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063572 5081 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063577 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2 Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063580 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063584 5081 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063588 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063591 5081 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063593 5081 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063596 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063599 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063601 5081 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063604 5081 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063607 5081 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063609 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063612 5081 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts Nov 02 13:43:02.077703 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063615 5081 feature_gate.go:386] unrecognized feature gate: EVPN Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063618 5081 feature_gate.go:386] unrecognized feature gate: Example Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063621 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063624 5081 feature_gate.go:386] unrecognized feature gate: SignatureStores Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063626 5081 feature_gate.go:386] unrecognized feature gate: Example2 Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063629 5081 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063632 5081 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063634 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063637 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063645 5081 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063648 5081 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063651 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063669 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063673 5081 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063679 5081 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063682 5081 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063685 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063688 5081 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063691 5081 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063694 5081 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager Nov 02 13:43:02.078232 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063697 5081 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063699 5081 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063702 5081 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063704 5081 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063707 5081 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063710 5081 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063713 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063715 5081 feature_gate.go:386] unrecognized feature gate: UpgradeStatus Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063718 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063720 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063722 5081 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063725 5081 feature_gate.go:386] unrecognized feature gate: NetworkConnect Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063728 5081 feature_gate.go:386] unrecognized feature gate: NewOLM Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063731 5081 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063733 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063736 5081 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063738 5081 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063741 5081 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063743 5081 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063747 5081 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards Nov 02 13:43:02.078838 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063749 5081 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063752 5081 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063759 5081 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063762 5081 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063765 5081 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063767 5081 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063771 5081 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063774 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063776 5081 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063779 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063781 5081 feature_gate.go:386] unrecognized feature gate: ShortCertRotation Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063784 5081 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063787 5081 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063789 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063792 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063795 5081 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063799 5081 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063802 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryption Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063805 5081 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall Nov 02 13:43:02.079510 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063808 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063811 5081 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063813 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063816 5081 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063818 5081 feature_gate.go:386] unrecognized feature gate: InsightsConfig Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063821 5081 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063823 5081 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063826 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063828 5081 feature_gate.go:386] unrecognized feature gate: OVNObservability Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063831 5081 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063833 5081 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063836 5081 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063838 5081 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063840 5081 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063843 5081 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063845 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063852 5081 feature_gate.go:386] unrecognized feature gate: NoOverlayMode Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063855 5081 feature_gate.go:386] unrecognized feature gate: DualReplica Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063858 5081 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063861 5081 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement Nov 02 13:43:02.080219 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063864 5081 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063867 5081 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063869 5081 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063872 5081 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063877 5081 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063880 5081 feature_gate.go:386] unrecognized feature gate: OSStreams Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063884 5081 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063887 5081 feature_gate.go:386] unrecognized feature gate: TLSAdherence Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063890 5081 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063893 5081 feature_gate.go:386] unrecognized feature gate: EventTTL Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063895 5081 feature_gate.go:386] unrecognized feature gate: ExternalOIDC Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063898 5081 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:02.063900 5081 feature_gate.go:386] unrecognized feature gate: DNSNameResolver Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.063985 5081 server.go:957] "Client rotation is on, will bootstrap in background" Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.064984 5081 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary" Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.065045 5081 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem" Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.065239 5081 server.go:1014] "Starting client certificate rotation" Nov 02 13:43:02.081087 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.065396 5081 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.065476 5081 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-01 13:37:20 +0000 UTC" deadline="2028-05-04 15:25:37.270034715 +0000 UTC" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.065560 5081 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13177h42m35.204480639s" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.065776 5081 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.066935 5081 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.068327 5081 log.go:25] "Validated CRI v1 runtime API" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.070113 5081 log.go:25] "Validated CRI v1 image API" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.070923 5081 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Nov 02 13:43:02.081762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.073032 5081 fs.go:135] Filesystem UUIDs: map[0b22b95e-c774-4e71-a7fd-f7481ac6628d:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9fdb8e05-5feb-464f-beb2-950bc652921c:/dev/nvme0n1p4] Nov 02 13:43:02.082005 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.073052 5081 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0235a3d1b286137f236c778147bcac4956329300fdc49a6d2d74422322e8ae4c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0235a3d1b286137f236c778147bcac4956329300fdc49a6d2d74422322e8ae4c/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/032ad711fec34f58a6be3f0053cf05bf8a2c65d1b874727922b7c431d05ab8c1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/032ad711fec34f58a6be3f0053cf05bf8a2c65d1b874727922b7c431d05ab8c1/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/05afe1c4a0c8df966c00b908dc39494e743da9c83dc5ec1acc69a89a507d4e0d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/05afe1c4a0c8df966c00b908dc39494e743da9c83dc5ec1acc69a89a507d4e0d/userdata/shm major:0 minor:337 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0b1cd995b31ca475a5f7cf51b0775bf3fccb2a61e0766794386b59578d5e52ba/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0b1cd995b31ca475a5f7cf51b0775bf3fccb2a61e0766794386b59578d5e52ba/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1cb4dd8cabdd2e8c0a537d4cd57ce97b997bbaf95b551b73d906c023a4e0d9e1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1cb4dd8cabdd2e8c0a537d4cd57ce97b997bbaf95b551b73d906c023a4e0d9e1/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/26498859fce7ce4e924e4d31af8766a65eec87a37a46a93a3358dc7347abedac/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/26498859fce7ce4e924e4d31af8766a65eec87a37a46a93a3358dc7347abedac/userdata/shm major:0 minor:344 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d0c4630abd73bce9b34583fbe9c36a0a7c2da02d992df51a16ef6f475f775e3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d0c4630abd73bce9b34583fbe9c36a0a7c2da02d992df51a16ef6f475f775e3/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2da2c156b66b85fc6cb93cc27d07e3e70eeb06c5c2ecfc9de2c01bde13dccb20/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2da2c156b66b85fc6cb93cc27d07e3e70eeb06c5c2ecfc9de2c01bde13dccb20/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/3fee6a6f7ee36fd24261b7e28af753b2af9ef7d13aae9ce2da5e7664036c09d2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/3fee6a6f7ee36fd24261b7e28af753b2af9ef7d13aae9ce2da5e7664036c09d2/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/49f9368d242d94a2e1b1b0dc68a7b20ffd0758a22ced96d147c8a890c881cc91/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/49f9368d242d94a2e1b1b0dc68a7b20ffd0758a22ced96d147c8a890c881cc91/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5/userdata/shm major:0 minor:64 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75803b147791f845453ca0baa6633ce1a48626787789d20676ac628d3c8c4f24/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75803b147791f845453ca0baa6633ce1a48626787789d20676ac628d3c8c4f24/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75be28aefedc44de4f24b8b4256bd948c7e2cf10d5d5397ca7823c0cc65dbcf2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75be28aefedc44de4f24b8b4256bd948c7e2cf10d5d5397ca7823c0cc65dbcf2/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8063e479ce2ad2689787fbc28a7e470c7caca8743bdba45e74bd3adbdb03395d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8063e479ce2ad2689787fbc28a7e470c7caca8743bdba45e74bd3adbdb03395d/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/824727a64b8f32c20b45bd3b9f563d6ee496197e5b84c123223b9fb58b464b05/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/824727a64b8f32c20b45bd3b9f563d6ee496197e5b84c123223b9fb58b464b05/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8f0cf0a1ad3ba784ce31898a177ad7ffb3a728b47c5e1daf9f16c11490620532/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8f0cf0a1ad3ba784ce31898a177ad7ffb3a728b47c5e1daf9f16c11490620532/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/961023a26942635ceb96e524f2d00694521f7fb0506c3a1b94055cd00380a6d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/961023a26942635ceb96e524f2d00694521f7fb0506c3a1b94055cd00380a6d9/userdata/shm major:0 minor:92 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ae763da57c12950356e6680caebf76957e8aecefcf26b18694c4ae9cd1ebc092/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ae763da57c12950356e6680caebf76957e8aecefcf26b18694c4ae9cd1ebc092/userdata/shm major:0 minor:245 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b8cd0492dcb3f36b67c5c0ca0301c4283e05f1934672b97971411b77a1d73f8b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b8cd0492dcb3f36b67c5c0ca0301c4283e05f1934672b97971411b77a1d73f8b/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bd36b88617fdf59b60c45499b66b1149dc7399c7f83445e02ec1997335002f46/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bd36b88617fdf59b60c45499b66b1149dc7399c7f83445e02ec1997335002f46/userdata/shm major:0 minor:272 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c7b806c991e625d4207b580401678a3224badc07e59afdfc0e07e91da834a68a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c7b806c991e625d4207b580401678a3224badc07e59afdfc0e07e91da834a68a/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ddc20af95313ee3e39a8231c663ddf10900bc507d65c4b8fcb61e605284fc1f8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ddc20af95313ee3e39a8231c663ddf10900bc507d65c4b8fcb61e605284fc1f8/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/de80354d572aab4e4265664586b2cb8d62bda64e08b15d1a60263ce3ec9460f0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/de80354d572aab4e4265664586b2cb8d62bda64e08b15d1a60263ce3ec9460f0/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f6cec6537ccbf2c9918f137e2e458621d4b3cd5c84db7fea52f0ceec9f049009/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f6cec6537ccbf2c9918f137e2e458621d4b3cd5c84db7fea52f0ceec9f049009/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d/userdata/shm major:0 minor:330 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/020f9532-0954-430c-b455-024cc6e03be3/volumes/kubernetes.io~projected/kube-api-access-kz58h:{mountpoint:/var/lib/kubelet/pods/020f9532-0954-430c-b455-024cc6e03be3/volumes/kubernetes.io~projected/kube-api-access-kz58h major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/020f9532-0954-430c-b455-024cc6e03be3/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/020f9532-0954-430c-b455-024cc6e03be3/volumes/kubernetes.io~secret/serving-cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/025cb66b-ee01-4a6f-9331-167cb5c214dc/volumes/kubernetes.io~projected/kube-api-access-6l97h:{mountpoint:/var/lib/kubelet/pods/025cb66b-ee01-4a6f-9331-167cb5c214dc/volumes/kubernetes.io~projected/kube-api-access-6l97h major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0817ddcd-6f81-4631-a580-bde045d0b712/volumes/kubernetes.io~projected/kube-api-access-rvlhq:{mountpoint:/var/lib/kubelet/pods/0817ddcd-6f81-4631-a580-bde045d0b712/volumes/kubernetes.io~projected/kube-api-access-rvlhq major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~projected/kube-api-access-wj4fn:{mountpoint:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~projected/kube-api-access-wj4fn major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/19ea4ba3-7292-4f14-8c78-77cf3cebd95c/volumes/kubernetes.io~projected/kube-api-access-dlqh7:{mountpoint:/var/lib/kubelet/pods/19ea4ba3-7292-4f14-8c78-77cf3cebd95c/volumes/kubernetes.io~projected/kube-api-access-dlqh7 major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1c89710e-5e4b-491c-84be-7da3dd910513/volumes/kubernetes.io~projected/kube-api-access-sxfjg:{mountpoint:/var/lib/kubelet/pods/1c89710e-5e4b-491c-84be-7da3dd910513/volumes/kubernetes.io~projected/kube-api-access-sxfjg major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2abda0cb-8e51-4003-942e-27eb6bf88e92/volumes/kubernetes.io~projected/kube-api-access-6mprs:{mountpoint:/var/lib/kubelet/pods/2abda0cb-8e51-4003-942e-27eb6bf88e92/volumes/kubernetes.io~projected/kube-api-access-6mprs major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34ad0bf5-0de3-43dc-b13a-6ef480ff447f/volumes/kubernetes.io~projected/kube-api-access-7gj8t:{mountpoint:/var/lib/kubelet/pods/34ad0bf5-0de3-43dc-b13a-6ef480ff447f/volumes/kubernetes.io~projected/kube-api-access-7gj8t major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/396ce5b5-d0e0-4200-8332-faed8c96a7ae/volumes/kubernetes.io~projected/kube-api-access-ccgxh:{mountpoint:/var/lib/kubelet/pods/396ce5b5-d0e0-4200-8332-faed8c96a7ae/volumes/kubernetes.io~projected/kube-api-access-ccgxh major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed/volumes/kubernetes.io~projected/kube-api-access-4jjj5:{mountpoint:/var/lib/kubelet/pods/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed/volumes/kubernetes.io~projected/kube-api-access-4jjj5 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~projected/kube-api-access-f6f2c:{mountpoint:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~projected/kube-api-access-f6f2c major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4335741f-3c45-4afb-81af-43c072a64c23/volumes/kubernetes.io~projected/kube-api-access-v5jxb:{mountpoint:/var/lib/kubelet/pods/4335741f-3c45-4afb-81af-43c072a64c23/volumes/kubernetes.io~projected/kube-api-access-v5jxb major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a8d8d3d-560d-4bf0-8160-b18403d85942/volumes/kubernetes.io~projected/kube-api-access-xb5zd:{mountpoint:/var/lib/kubelet/pods/4a8d8d3d-560d-4bf0-8160-b18403d85942/volumes/kubernetes.io~projected/kube-api-access-xb5zd major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4a8d8d3d-560d-4bf0-8160-b18403d85942/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/4a8d8d3d-560d-4bf0-8160-b18403d85942/volumes/kubernetes.io~secret/signing-key major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda/volumes/kubernetes.io~projected/kube-api-access-cnsxj:{mountpoint:/var/lib/kubelet/pods/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda/volumes/kubernetes.io~projected/kube-api-access-cnsxj major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~projected/kube-api-access-wjbh4:{mountpoint:/var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~projected/kube-api-access-wjbh4 major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~secret/default-certificate major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~secret/stats-auth major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/708e90f2-a35b-4028-b1e6-8e364d12b86b/volumes/kubernetes.io~projected/kube-api-access-5hqb6:{mountpoint:/var/lib/kubelet/pods/708e90f2-a35b-4028-b1e6-8e364d12b86b/volumes/kubernetes.io~projected/kube-api-access-5hqb6 major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/708e90f2-a35b-4028-b1e6-8e364d12b86b/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/708e90f2-a35b-4028-b1e6-8e364d12b86b/volumes/kubernetes.io~secret/serving-cert major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/79880279-3cc7-450e-b2f1-e52a527be2c0/volumes/kubernetes.io~projected/kube-api-access-8sk2t:{mountpoint:/var/lib/kubelet/pods/79880279-3cc7-450e-b2f1-e52a527be2c0/volumes/kubernetes.io~projected/kube-api-access-8sk2t major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8011c9f0-6ebd-4e37-8500-ebf56305e263/volumes/kubernetes.io~projected/kube-api-access-lhtqt:{mountpoint:/var/lib/kubelet/pods/8011c9f0-6ebd-4e37-8500-ebf56305e263/volumes/kubernetes.io~projected/kube-api-access-lhtqt major:0 minor:314 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/88248243-f1a3-4b12-a156-78be12e1add9/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/88248243-f1a3-4b12-a156-78be12e1add9/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:268 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd/volumes/kubernetes.io~projected/kube-api-access-xqn5h:{mountpoint:/var/lib/kubelet/pods/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd/volumes/kubernetes.io~projected/kube-api-access-xqn5h major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f1e1f78-6650-47b7-bd32-33ff5e2ad398/volumes/kubernetes.io~projected/kube-api-access-c69kk:{mountpoint:/var/lib/kubelet/pods/9f1e1f78-6650-47b7-bd32-33ff5e2ad398/volumes/kubernetes.io~projected/kube-api-access-c69kk major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f1e1f78-6650-47b7-bd32-33ff5e2ad398/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/9f1e1f78-6650-47b7-bd32-33ff5e2ad398/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~empty-dir/tmp major:0 minor:52 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~projected/kube-api-access-scsx9:{mountpoint:/var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~projected/kube-api-access-scsx9 major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/af544062-fa2e-4ef5-b2c5-a849d8c5c109/volumes/kubernetes.io~projected/kube-api-access-lcbqw:{mountpoint:/var/lib/kubelet/pods/af544062-fa2e-4ef5-b2c5-a849d8c5c109/volumes/kubernetes.io~projected/kube-api-access-lcbqw major:0 minor:271 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3d9d21b-0ce4-477e-acd2-a26f2e411b89/volumes/kubernetes.io~projected/kube-api-access-8nzms:{mountpoint:/var/lib/kubelet/pods/b3d9d21b-0ce4-477e-acd2-a26f2e411b89/volumes/kubernetes.io~projected/kube-api-access-8nzms major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3d9d21b-0ce4-477e-acd2-a26f2e411b89/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/b3d9d21b-0ce4-477e-acd2-a26f2e411b89/volumes/kubernetes.io~secret/cert major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c042d838-3403-46c5-a3af-c86e1702f01d/volumes/kubernetes.io~projected/kube-api-access-9g8jc:{mountpoint:/var/lib/kubelet/pods/c042d838-3403-46c5-a3af-c86e1702f01d/volumes/kubernetes.io~projected/kube-api-access-9g8jc major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c27c165b-51d8-422e-9304-5c9df56cffcd/volumes/kubernetes.io~projected/kube-api-access-l9v6c:{mountpoint:/var/lib/kubelet/pods/c27c165b-51d8-422e-9304-5c9df56cffcd/volumes/kubernetes.io~projected/kube-api-access-l9v6c major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d3290f58-c76c-4996-8bfa-dc0863a18ad5/volumes/kubernetes.io~projected/kube-api-access-x7vq4:{mountpoint:/var/lib/kubelet/pods/d3290f58-c76c-4996-8bfa-dc0863a18ad5/volumes/kubernetes.io~projected/kube-api-access-x7vq4 major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volumes/kubernetes.io~projected/kube-api-access-lfl2t:{mountpoint:/var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volumes/kubernetes.io~projected/kube-api-access-lfl2t major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d99fc9f1-2f2f-4049-81ae-172359417cdc/volumes/kubernetes.io~projected/kube-api-access-68t9l:{mountpoint:/var/lib/kubelet/pods/d99fc9f1-2f2f-4049-81ae-172359417cdc/volumes/kubernetes.io~projected/kube-api-access-68t9l major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/dd231bc3-ed1b-4516-8327-05de58219655/volumes/kubernetes.io~projected/kube-api-access-mq9lc:{mountpoint:/var/lib/kubelet/pods/dd231bc3-ed1b-4516-8327-05de58219655/volumes/kubernetes.io~projected/kube-api-access-mq9lc major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e6de1ad4-49f8-4b2a-b781-1339bcf825b7/volumes/kubernetes.io~projected/kube-api-access-pxwdg:{mountpoint:/var/lib/kubelet/pods/e6de1ad4-49f8-4b2a-b781-1339bcf825b7/volumes/kubernetes.io~projected/kube-api-access-pxwdg major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ece5836e-24ec-4d8d-b607-0fdd65af45a7/volumes/kubernetes.io~projected/kube-api-access-pfp6x:{mountpoint:/var/lib/kubelet/pods/ece5836e-24ec-4d8d-b607-0fdd65af45a7/volumes/kubernetes.io~projected/kube-api-access-pfp6x major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d/volumes/kubernetes.io~secret/agent-certs major:0 minor:53 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/4de5f8e8964944f9e983d55cbe381f60e7091f720e555fc902339615e17df696/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/76ce60b568ac8e9e91fc394c18f6c1fe094eb9b4114a4904c8c799bbfbbea232/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/472cb73655b90bc890b7c3f32d082d4960d3bbfe04f0ee1ac75cfec737e293aa/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-109:{mountpoint:/var/lib/containers/storage/overlay/afa467a97a784ee47c7e360d7b7a26a6ac38aa6d54ba98aa2cd1e0e3d1f0a5cb/merged major:0 minor:109 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/4fd60e5c1e7e009356635a1530be362f718666a216455f501c7f261d74554d47/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/ec1b52f39b2b87cb5dfa79cea7f8b6acefe66ef61e0ea52c428ecee18a471614/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-122:{mountpoint:/var/lib/containers/storage/overlay/2fddc8ae0c0380148b9fc748767e0cc4ce6d14745460d1f247dcfb7765cc0cfe/merged major:0 minor:122 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/4f3c42be3fbbed63a8c012c81dfd31b4697da748da73aa8191796d4cf6142a42/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/35288520a01581af05cc4afca0dfb276d51f085b37ef83d6cec9545fb9ef2aa4/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/5739a52914c5d7fadd3f5a2a73e1c402cbea83d772eda6b8bc9aac60bd6372ab/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/e3d4cf64dd777597e29aae549606620a9c452f4bbc30bf8b1f382e03554842e2/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-141:{mountpoint:/var/lib/containers/storage/overlay/70da11e7183b69b284ea635616e6effa9dec7c79ce2e3993336ef20c778bd406/merged major:0 minor:141 fsType:overlay blockSize:0} overlay_0-149:{mountpoint:/var/lib/containers/storage/overlay/d14a7bd5e024f7c5acc5d5df096188770f478e70bb04eaa580a2c515e8c842b0/merged major:0 minor:149 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/42652fcdc6686080ec770ee32f48d384ec6cd3c1be13745747e372e93207d372/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/aecefa9bbc19830876cdd5ab64ff43302afb95fac2919b4e40b3670a24ee0a5a/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/c3b81cde996efb179dba693bdc705a74a7f32f893a9b8b9f91ea5e31fd83d10d/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-168:{mountpoint:/var/lib/containers/storage/overlay/aee707d867b273c5d9befe556f8da2a5dd2efe00ad34a9134f36a794a383f951/merged major:0 minor:168 fsType:overlay blockSize:0} overlay_0-174:{mountpoint:/var/lib/containers/storage/overlay/a5e8a1876478115e28b17cc4947ec739135597ac43872e42a7f3f37b7825b28e/merged major:0 minor:174 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/46e2086f67b76475c3f2f64a5216fe0167e71fa8b53621c9476164b2983c3855/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/d1c30c72f32ba06a719e1256cbb2b874ca59aefb31843ce1e5d47675bc2c50e2/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/faa76c720d2ea11570f190c0b4fe2fe30b1286aca460fc355e507666c68f5c96/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/06d488c4e1df0bb18db6c4b91246263707c96cb5f05861daaf3348cac59b3921/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/f762b2bcf144254405ecbbf5334f515daf557a33284cbbb9b9c696dc712de0bb/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/3ae9a1c1df392f88909db54ef2aa7464de96a2d97a055de4a797de726e175261/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/fd01257e38caa0df0c95fb81be7996d3c87e3dc94cce3852193343bf2fa2c725/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/818b704e322920553199a9baa9163a78d02afcb993720ad67a732d9e5e6dd07a/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/f674427042d651fe78e0765ff0cfddbce5e525dae95402414c2eeaba50746ef0/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/42912d8aae57f5c798ebf9a3a8fac74ecaa8b8dbf663542ea08ce98f9c9b25eb/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/687f71de252e92dd711c3bceb42e7dd731ab15b1774e6d1fbd9c9fbe1b6838da/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/0c8219a3661145a5d9d0af83621304935685d0638860d464ba2a73dc385d97ae/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/4d14dce01b1543466d5c7b957c3f7db7c1d116fda7187c057a360586c76837cc/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/385e8cc9a28c6f4898f29b73350567ce2c57f57ee0df75ee91dbaefc08bf07fd/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-277:{mountpoint:/var/lib/containers/storage/overlay/41d61b4dba84abad83f622a4ea6011c1a3a8dde9c6e95fc3a7fcf7a4425941b8/merged major:0 minor:277 fsType:overlay blockSize:0} overlay_0-283:{mountpoint:/var/lib/containers/storage/overlay/d49a037e7b133af5f2480e2e3fd5a722c138cb7efc1b03fe0649bf798e5f2a19/merged major:0 minor:283 fsType:overlay blockSize:0} overlay_0-292:{mountpoint:/var/lib/containers/storage/overlay/587cd7d04a439f0452c413f348c395f32b300863dc530f23bbdd1736e077ae35/merged major:0 minor:292 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/617ea237f1ab8d780253d3197288fd42ced1c2a2d694abd1280eb961b02ce3fc/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-296:{mountpoint:/var/lib/containers/storage/overlay/5bab90e0fe159658aacb3581854603a33fc0be16a3a997129f636d8eff66d28a/merged major:0 minor:296 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/b0af639ee0cdcaeaee70e13bedbf537ee875a4537ec023d7551928e1708da4f9/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/a5bfa1a7036f7bf7a6032b0583afdbb9ce148d59feb1273aa30baca9f45a7456/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-306:{mountpoint:/var/lib/containers/storage/overlay/1531268bffb895614d7566311f97132c9a4c5237054b63130bd5e603958c58a8/merged major:0 minor:306 fsType:overlay blockSize:0} overlay_0-308:{mountpoint:/var/lib/containers/storage/overlay/c1b999c13113be8f731a2661d7a2e031cc0509006b88d99c7f45e09a56d7c76a/merged major:0 minor:308 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/ebf9728148fc974b637ea49c95cd9b3022e8b0fa78240a37105faac1d836136f/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-346:{mountpoint:/var/lib/containers/storage/overlay/b0d78052e6b2f0bb3162bbeff3069c26239a2c3080f040f6e68191abcae1582e/merged major:0 minor:346 fsType:overlay blockSize:0} overlay_0-348:{mountpoint:/var/lib/containers/storage/overlay/00c1dce9f9c9950fe62de5c37351b3af2c8b1421bccc5a65803c0ac4d4166fef/merged major:0 minor:348 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/6192a5ac5ccbba6d207280f9bd8a0fd9962f247ea15deb8b47bd04dfb6e04d17/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/348c263843ffc5160116ee64afc56382379c6a3a43adcd2d264a8ca17f2311c1/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/eb9919561a379b7020b89dddfbf87d96610ce9b640a5b70b2555c8704f8f2f49/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-364:{mountpoint:/var/lib/containers/storage/overlay/f8fe319e886b6c26ab5bb0fbebcea9e2cc2b974b48ba679824a61ca5f223a91b/merged major:0 minor:364 fsType:overlay blockSize:0} overlay_0-366:{mountpoint:/var/lib/containers/storage/overlay/59b19ede6e00ff0919215c84bed73b5f51213e7545d3d23671df11c50b76b7ae/merged major:0 minor:366 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/054132e8fefc655859043d29d230884d5044e6c4e0f3d4b81f05da349774bca2/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/820b0483da3c0750eb1513a10117a49b8863e77c044b87e0c4a89214a2ab1ba0/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/ad5a21d555978464708d7da0f15864415c0bf17a6741bea99978791c82105881/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/55aaaeefc072a03c15f88f9df786bccaae78e72c6dc14fe93f690461bc6c4fdd/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/0f5c507a8fde6768aa4eef2206cd4096d39fd59eb6a5d7ade6caf903d4e0e120/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/fc077136f9bdf0cb45ae3635e606d6b64b2830d3f87ae4bc3315414d8551cc16/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/ee2c3a0403c4312d76714a40150f72f244267526c6d8c1765278722c4e635dd3/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/c49244e5551049925aacc056229af12426e995b7cdb3e5854d6cfe55f0d12be4/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/c08cf888e2944b635af7a868f6f64ce5591f85fe468394bcaf562f30a7c60730/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/a8a72f3266d4136a08b1ddd3b937dc72b91cd2993575adb4f10a95ce1b4924c0/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-90:{mountpoint:/var/lib/containers/storage/overlay/85c5789d52015aec6d476d7989cc6b8c2b7dea1d38d24f19f257d6d2310bc2f7/merged major:0 minor:90 fsType:overlay blockSize:0} overlay_0-94:{mountpoint:/var/lib/containers/storage/overlay/fb895c1b8b2e14db39ba28b7311904b70770a2a4070d6656bb21863dcb0e6218/merged major:0 minor:94 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/81a44e7635f86dab62bd6f8810cc408774b7730113dec2d5bdce6675b60881f1/merged major:0 minor:96 fsType:overlay blockSize:0}] Nov 02 13:43:02.084086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.083030 5081 manager.go:217] Machine: {Timestamp:2026-11-02 13:43:02.082251389 +0000 UTC m=+0.074639664 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099464 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26b1bf2134bd98098e89c0101d9657 SystemUUID:ec26b1bf-2134-bd98-098e-89c0101d9657 BootID:fbfaa231-d209-4120-b31d-a9bd927a44b9 Filesystems:[{Device:/var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:50 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f6cec6537ccbf2c9918f137e2e458621d4b3cd5c84db7fea52f0ceec9f049009/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-149 DeviceMajor:0 DeviceMinor:149 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/025cb66b-ee01-4a6f-9331-167cb5c214dc/volumes/kubernetes.io~projected/kube-api-access-6l97h DeviceMajor:0 DeviceMinor:49 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-90 DeviceMajor:0 DeviceMinor:90 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/05afe1c4a0c8df966c00b908dc39494e743da9c83dc5ec1acc69a89a507d4e0d/userdata/shm DeviceMajor:0 DeviceMinor:337 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:51 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/26498859fce7ce4e924e4d31af8766a65eec87a37a46a93a3358dc7347abedac/userdata/shm DeviceMajor:0 DeviceMinor:344 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-364 DeviceMajor:0 DeviceMinor:364 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~projected/kube-api-access-scsx9 DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1cb4dd8cabdd2e8c0a537d4cd57ce97b997bbaf95b551b73d906c023a4e0d9e1/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/e6de1ad4-49f8-4b2a-b781-1339bcf825b7/volumes/kubernetes.io~projected/kube-api-access-pxwdg DeviceMajor:0 DeviceMinor:219 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c042d838-3403-46c5-a3af-c86e1702f01d/volumes/kubernetes.io~projected/kube-api-access-9g8jc DeviceMajor:0 DeviceMinor:54 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b8cd0492dcb3f36b67c5c0ca0301c4283e05f1934672b97971411b77a1d73f8b/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:209 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~projected/kube-api-access-wj4fn DeviceMajor:0 DeviceMinor:214 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-308 DeviceMajor:0 DeviceMinor:308 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/79880279-3cc7-450e-b2f1-e52a527be2c0/volumes/kubernetes.io~projected/kube-api-access-8sk2t DeviceMajor:0 DeviceMinor:333 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-348 DeviceMajor:0 DeviceMinor:348 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-141 DeviceMajor:0 DeviceMinor:141 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:213 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8f0cf0a1ad3ba784ce31898a177ad7ffb3a728b47c5e1daf9f16c11490620532/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/3fee6a6f7ee36fd24261b7e28af753b2af9ef7d13aae9ce2da5e7664036c09d2/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-109 DeviceMajor:0 DeviceMinor:109 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:53 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5/userdata/shm DeviceMajor:0 DeviceMinor:64 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/708e90f2-a35b-4028-b1e6-8e364d12b86b/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:207 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/396ce5b5-d0e0-4200-8332-faed8c96a7ae/volumes/kubernetes.io~projected/kube-api-access-ccgxh DeviceMajor:0 DeviceMinor:218 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-283 DeviceMajor:0 DeviceMinor:283 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/de80354d572aab4e4265664586b2cb8d62bda64e08b15d1a60263ce3ec9460f0/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-168 DeviceMajor:0 DeviceMinor:168 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1c89710e-5e4b-491c-84be-7da3dd910513/volumes/kubernetes.io~projected/kube-api-access-sxfjg DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/961023a26942635ceb96e524f2d00694521f7fb0506c3a1b94055cd00380a6d9/userdata/shm DeviceMajor:0 DeviceMinor:92 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ddc20af95313ee3e39a8231c663ddf10900bc507d65c4b8fcb61e605284fc1f8/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-296 DeviceMajor:0 DeviceMinor:296 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4a8d8d3d-560d-4bf0-8160-b18403d85942/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:328 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/34ad0bf5-0de3-43dc-b13a-6ef480ff447f/volumes/kubernetes.io~projected/kube-api-access-7gj8t DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75803b147791f845453ca0baa6633ce1a48626787789d20676ac628d3c8c4f24/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/020f9532-0954-430c-b455-024cc6e03be3/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/020f9532-0954-430c-b455-024cc6e03be3/volumes/kubernetes.io~projected/kube-api-access-kz58h DeviceMajor:0 DeviceMinor:222 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0b1cd995b31ca475a5f7cf51b0775bf3fccb2a61e0766794386b59578d5e52ba/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ae763da57c12950356e6680caebf76957e8aecefcf26b18694c4ae9cd1ebc092/userdata/shm DeviceMajor:0 DeviceMinor:245 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-306 DeviceMajor:0 DeviceMinor:306 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2da2c156b66b85fc6cb93cc27d07e3e70eeb06c5c2ecfc9de2c01bde13dccb20/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-174 DeviceMajor:0 DeviceMinor:174 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~projected/kube-api-access-wjbh4 DeviceMajor:0 DeviceMinor:217 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2abda0cb-8e51-4003-942e-27eb6bf88e92/volumes/kubernetes.io~projected/kube-api-access-6mprs DeviceMajor:0 DeviceMinor:327 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/d54597ed-15b3-4939-a362-3f83728cff0f/volumes/kubernetes.io~projected/kube-api-access-lfl2t DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-122 DeviceMajor:0 DeviceMinor:122 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/708e90f2-a35b-4028-b1e6-8e364d12b86b/volumes/kubernetes.io~projected/kube-api-access-5hqb6 DeviceMajor:0 DeviceMinor:211 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bd36b88617fdf59b60c45499b66b1149dc7399c7f83445e02ec1997335002f46/userdata/shm DeviceMajor:0 DeviceMinor:272 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c27c165b-51d8-422e-9304-5c9df56cffcd/volumes/kubernetes.io~projected/kube-api-access-l9v6c DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:206 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda/volumes/kubernetes.io~projected/kube-api-access-cnsxj DeviceMajor:0 DeviceMinor:225 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a985c061-f494-4e9f-998b-d61d83969dd0/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:52 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/b3d9d21b-0ce4-477e-acd2-a26f2e411b89/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:205 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-292 DeviceMajor:0 DeviceMinor:292 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/19ea4ba3-7292-4f14-8c78-77cf3cebd95c/volumes/kubernetes.io~projected/kube-api-access-dlqh7 DeviceMajor:0 DeviceMinor:332 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-346 DeviceMajor:0 DeviceMinor:346 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d3290f58-c76c-4996-8bfa-dc0863a18ad5/volumes/kubernetes.io~projected/kube-api-access-x7vq4 DeviceMajor:0 DeviceMinor:48 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4335741f-3c45-4afb-81af-43c072a64c23/volumes/kubernetes.io~projected/kube-api-access-v5jxb DeviceMajor:0 DeviceMinor:212 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~projected/kube-api-access-f6f2c DeviceMajor:0 DeviceMinor:221 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/49f9368d242d94a2e1b1b0dc68a7b20ffd0758a22ced96d147c8a890c881cc91/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/88248243-f1a3-4b12-a156-78be12e1add9/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:268 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5c2be26f-f492-4cb0-a5f1-9840c4ff2437/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ece5836e-24ec-4d8d-b607-0fdd65af45a7/volumes/kubernetes.io~projected/kube-api-access-pfp6x DeviceMajor:0 DeviceMinor:227 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/824727a64b8f32c20b45bd3b9f563d6ee496197e5b84c123223b9fb58b464b05/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-277 DeviceMajor:0 DeviceMinor:277 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d99fc9f1-2f2f-4049-81ae-172359417cdc/volumes/kubernetes.io~projected/kube-api-access-68t9l DeviceMajor:0 DeviceMinor:216 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d/userdata/shm DeviceMajor:0 DeviceMinor:330 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-366 DeviceMajor:0 DeviceMinor:366 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-94 DeviceMajor:0 DeviceMinor:94 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9f1e1f78-6650-47b7-bd32-33ff5e2ad398/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8011c9f0-6ebd-4e37-8500-ebf56305e263/volumes/kubernetes.io~projected/kube-api-access-lhtqt DeviceMajor:0 DeviceMinor:314 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4a8d8d3d-560d-4bf0-8160-b18403d85942/volumes/kubernetes.io~projected/kube-api-access-xb5zd DeviceMajor:0 DeviceMinor:329 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd/volumes/kubernetes.io~projected/kube-api-access-xqn5h DeviceMajor:0 DeviceMinor:210 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0235a3d1b286137f236c778147bcac4956329300fdc49a6d2d74422322e8ae4c/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c7b806c991e625d4207b580401678a3224badc07e59afdfc0e07e91da834a68a/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/dd231bc3-ed1b-4516-8327-05de58219655/volumes/kubernetes.io~projected/kube-api-access-mq9lc DeviceMajor:0 DeviceMinor:215 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:226 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8063e479ce2ad2689787fbc28a7e470c7caca8743bdba45e74bd3adbdb03395d/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75be28aefedc44de4f24b8b4256bd948c7e2cf10d5d5397ca7823c0cc65dbcf2/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:202 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0817ddcd-6f81-4631-a580-bde045d0b712/volumes/kubernetes.io~projected/kube-api-access-rvlhq DeviceMajor:0 DeviceMinor:47 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:208 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/b3d9d21b-0ce4-477e-acd2-a26f2e411b89/volumes/kubernetes.io~projected/kube-api-access-8nzms DeviceMajor:0 DeviceMinor:224 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/032ad711fec34f58a6be3f0053cf05bf8a2c65d1b874727922b7c431d05ab8c1/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed/volumes/kubernetes.io~projected/kube-api-access-4jjj5 DeviceMajor:0 DeviceMinor:223 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/af544062-fa2e-4ef5-b2c5-a849d8c5c109/volumes/kubernetes.io~projected/kube-api-access-lcbqw DeviceMajor:0 DeviceMinor:271 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d0c4630abd73bce9b34583fbe9c36a0a7c2da02d992df51a16ef6f475f775e3/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9f1e1f78-6650-47b7-bd32-33ff5e2ad398/volumes/kubernetes.io~projected/kube-api-access-c69kk DeviceMajor:0 DeviceMinor:220 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0235a3d1b286137 MacAddress:5a:e3:99:74:0c:d9 Speed:10000 Mtu:8901} {Name:032ad711fec34f5 MacAddress:7e:a6:f7:68:38:a4 Speed:10000 Mtu:8901} {Name:05afe1c4a0c8df9 MacAddress:ce:43:7f:dd:c3:b3 Speed:10000 Mtu:8901} {Name:0b1cd995b31ca47 MacAddress:6a:4d:aa:23:5b:84 Speed:10000 Mtu:8901} {Name:26498859fce7ce4 MacAddress:ba:f6:46:a0:5b:d9 Speed:10000 Mtu:8901} {Name:2d0c4630abd73bc MacAddress:56:a7:c3:44:76:b0 Speed:10000 Mtu:8901} {Name:3fee6a6f7ee36fd MacAddress:7a:90:2c:f8:cf:b3 Speed:10000 Mtu:8901} {Name:49f9368d242d94a MacAddress:72:39:58:37:6e:18 Speed:10000 Mtu:8901} {Name:75be28aefedc44d MacAddress:5e:95:e3:03:01:9a Speed:10000 Mtu:8901} {Name:8063e479ce2ad26 MacAddress:4a:37:79:c5:dc:52 Speed:10000 Mtu:8901} {Name:824727a64b8f32c MacAddress:2a:cb:9d:10:85:36 Speed:10000 Mtu:8901} {Name:8f0cf0a1ad3ba78 MacAddress:56:b8:81:d6:5e:78 Speed:10000 Mtu:8901} {Name:ae763da57c12950 MacAddress:fa:ee:5c:1a:e5:6a Speed:10000 Mtu:8901} {Name:bd36b88617fdf59 MacAddress:ce:36:97:a2:ac:04 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:cb:e5:6a:b7 Speed:0 Mtu:9001} {Name:br-int MacAddress:c6:4e:46:55:88:f1 Speed:0 Mtu:8901} {Name:ddc20af95313ee3 MacAddress:2e:ed:f8:fe:b0:d8 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:cb:e5:6a:b7 Speed:0 Mtu:9001} {Name:ff5aceee486a334 MacAddress:f6:1e:b2:db:ff:ae Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:06:94:5a:fc:c1:79 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:0e:9c:2d:32:8c:05 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Nov 02 13:43:02.084086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.083695 5081 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Nov 02 13:43:02.084086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.083761 5081 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Nov 02 13:43:02.084086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084038 5081 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Nov 02 13:43:02.084425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084063 5081 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-60.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Nov 02 13:43:02.084425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084242 5081 topology_manager.go:143] "Creating topology manager with none policy" Nov 02 13:43:02.084425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084253 5081 container_manager_linux.go:311] "Creating device plugin manager" Nov 02 13:43:02.084425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084267 5081 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 13:43:02.084425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084286 5081 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Nov 02 13:43:02.084425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084311 5081 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager" Nov 02 13:43:02.084611 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084512 5081 state_mem.go:41] "Initialized" logger="CPUManager state memory" Nov 02 13:43:02.084690 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084678 5081 server.go:1235] "Using root directory" path="/var/lib/kubelet" Nov 02 13:43:02.084733 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084724 5081 kubelet.go:493] "Attempting to sync node with API server" Nov 02 13:43:02.084766 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084744 5081 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests" Nov 02 13:43:02.084766 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084756 5081 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Nov 02 13:43:02.084827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084769 5081 kubelet.go:405] "Adding apiserver pod source" Nov 02 13:43:02.084827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.084781 5081 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Nov 02 13:43:02.085625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.085610 5081 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 02 13:43:02.085625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.085624 5081 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 13:43:02.086277 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.086259 5081 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1" Nov 02 13:43:02.088595 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.088582 5081 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint" Nov 02 13:43:02.088595 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.088594 5081 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Nov 02 13:43:02.088696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.088686 5081 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem" Nov 02 13:43:02.088882 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.088872 5081 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Nov 02 13:43:02.088912 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.088901 5081 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Nov 02 13:43:02.088999 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.088991 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Nov 02 13:43:02.089029 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089007 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Nov 02 13:43:02.089029 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089014 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Nov 02 13:43:02.089029 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089019 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Nov 02 13:43:02.089029 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089025 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089031 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089037 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089042 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089049 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089056 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089070 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089081 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089106 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Nov 02 13:43:02.089134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.089112 5081 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Nov 02 13:43:02.092753 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.092738 5081 server.go:1263] "Started kubelet" Nov 02 13:43:02.092887 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.092834 5081 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Nov 02 13:43:02.092942 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.092911 5081 server_v1.go:49] "podresources" method="list" useActivePods=true Nov 02 13:43:02.093397 ip-10-0-134-60 systemd[1]: Started Kubernetes Kubelet. Nov 02 13:43:02.094016 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.093995 5081 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Nov 02 13:43:02.095839 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.094108 5081 server.go:182] "Starting to listen" address="0.0.0.0" port=10250 Nov 02 13:43:02.095839 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.095682 5081 server.go:317] "Adding debug handlers to kubelet server" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.098145 5081 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.098522 5081 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.098774 5081 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-01 13:37:21 +0000 UTC" deadline="2028-05-22 08:30:49.864283001 +0000 UTC" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.098816 5081 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13602h47m47.765470749s" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.098992 5081 volume_manager.go:309] "The desired_state_of_world populator starts" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.099006 5081 volume_manager.go:311] "Starting Kubelet Volume Manager" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:02.099022 5081 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-60.us-east-2.compute.internal\" not found" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.099080 5081 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.099733 5081 factory.go:55] Registering systemd factory Nov 02 13:43:02.100600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.099749 5081 factory.go:223] Registration of the systemd container factory successfully Nov 02 13:43:02.103698 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.103656 5081 factory.go:153] Registering CRI-O factory Nov 02 13:43:02.103947 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.103925 5081 factory.go:223] Registration of the crio container factory successfully Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104006 5081 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104033 5081 factory.go:103] Registering Raw factory Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104051 5081 manager.go:1199] Started watching for new ooms in manager Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104387 5081 manager.go:319] Starting recovery of all containers Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104483 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="020f9532-0954-430c-b455-024cc6e03be3" volumeName="kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-snapshots" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104520 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c89710e-5e4b-491c-84be-7da3dd910513" volumeName="kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-binary-copy" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104551 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" volumeName="kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-trusted-ca" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104563 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b06c7cb-83c1-4b64-9651-d8be16cd4142" volumeName="kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104571 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="020f9532-0954-430c-b455-024cc6e03be3" volumeName="kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-trusted-ca-bundle" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104578 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" volumeName="kubernetes.io/projected/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-kube-api-access-c69kk" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104586 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d3290f58-c76c-4996-8bfa-dc0863a18ad5" volumeName="kubernetes.io/configmap/d3290f58-c76c-4996-8bfa-dc0863a18ad5-iptables-alerter-script" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104592 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="025cb66b-ee01-4a6f-9331-167cb5c214dc" volumeName="kubernetes.io/projected/025cb66b-ee01-4a6f-9331-167cb5c214dc-kube-api-access-6l97h" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104602 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c89710e-5e4b-491c-84be-7da3dd910513" volumeName="kubernetes.io/projected/1c89710e-5e4b-491c-84be-7da3dd910513-kube-api-access-sxfjg" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104609 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a8d8d3d-560d-4bf0-8160-b18403d85942" volumeName="kubernetes.io/configmap/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-cabundle" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104617 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c2be26f-f492-4cb0-a5f1-9840c4ff2437" volumeName="kubernetes.io/projected/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-kube-api-access-wjbh4" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104624 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c27c165b-51d8-422e-9304-5c9df56cffcd" volumeName="kubernetes.io/projected/c27c165b-51d8-422e-9304-5c9df56cffcd-kube-api-access-l9v6c" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104648 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d" volumeName="kubernetes.io/secret/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-agent-certs" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104656 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bc533a9-cb34-4ac4-a40d-c32d8cb70eda" volumeName="kubernetes.io/projected/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda-kube-api-access-cnsxj" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104665 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="19ea4ba3-7292-4f14-8c78-77cf3cebd95c" volumeName="kubernetes.io/projected/19ea4ba3-7292-4f14-8c78-77cf3cebd95c-kube-api-access-dlqh7" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104672 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b06c7cb-83c1-4b64-9651-d8be16cd4142" volumeName="kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104679 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b06c7cb-83c1-4b64-9651-d8be16cd4142" volumeName="kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104686 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b06c7cb-83c1-4b64-9651-d8be16cd4142" volumeName="kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104693 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="396ce5b5-d0e0-4200-8332-faed8c96a7ae" volumeName="kubernetes.io/configmap/396ce5b5-d0e0-4200-8332-faed8c96a7ae-telemetry-config" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104700 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e9ac3c3-9b57-4528-94bd-08d35a0c23ed" volumeName="kubernetes.io/configmap/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-config" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104708 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="425863c0-acb7-4822-89c6-2329077e182e" volumeName="kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104715 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abda0cb-8e51-4003-942e-27eb6bf88e92" volumeName="kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104722 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abda0cb-8e51-4003-942e-27eb6bf88e92" volumeName="kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104730 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="396ce5b5-d0e0-4200-8332-faed8c96a7ae" volumeName="kubernetes.io/projected/396ce5b5-d0e0-4200-8332-faed8c96a7ae-kube-api-access-ccgxh" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104737 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="88248243-f1a3-4b12-a156-78be12e1add9" volumeName="kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104744 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d99fc9f1-2f2f-4049-81ae-172359417cdc" volumeName="kubernetes.io/projected/d99fc9f1-2f2f-4049-81ae-172359417cdc-kube-api-access-68t9l" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104751 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd231bc3-ed1b-4516-8327-05de58219655" volumeName="kubernetes.io/configmap/dd231bc3-ed1b-4516-8327-05de58219655-config-volume" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104758 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e6de1ad4-49f8-4b2a-b781-1339bcf825b7" volumeName="kubernetes.io/projected/e6de1ad4-49f8-4b2a-b781-1339bcf825b7-kube-api-access-pxwdg" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104773 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ece5836e-24ec-4d8d-b607-0fdd65af45a7" volumeName="kubernetes.io/projected/ece5836e-24ec-4d8d-b607-0fdd65af45a7-kube-api-access-pfp6x" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104781 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="425863c0-acb7-4822-89c6-2329077e182e" volumeName="kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104788 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="425863c0-acb7-4822-89c6-2329077e182e" volumeName="kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104795 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd" volumeName="kubernetes.io/configmap/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-config" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104811 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="af544062-fa2e-4ef5-b2c5-a849d8c5c109" volumeName="kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104818 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd231bc3-ed1b-4516-8327-05de58219655" volumeName="kubernetes.io/empty-dir/dd231bc3-ed1b-4516-8327-05de58219655-tmp-dir" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104862 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d" volumeName="kubernetes.io/configmap/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-konnectivity-ca" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104870 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b06c7cb-83c1-4b64-9651-d8be16cd4142" volumeName="kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104877 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="708e90f2-a35b-4028-b1e6-8e364d12b86b" volumeName="kubernetes.io/configmap/708e90f2-a35b-4028-b1e6-8e364d12b86b-config" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104885 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd" volumeName="kubernetes.io/secret/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-serving-cert" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104894 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c89710e-5e4b-491c-84be-7da3dd910513" volumeName="kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-whereabouts-flatfile-configmap" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104902 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abda0cb-8e51-4003-942e-27eb6bf88e92" volumeName="kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104909 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0108f6ec-1c16-4842-b63b-40b820bb1867" volumeName="kubernetes.io/configmap/0108f6ec-1c16-4842-b63b-40b820bb1867-nginx-conf" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104927 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="020f9532-0954-430c-b455-024cc6e03be3" volumeName="kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-tmp" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104936 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="020f9532-0954-430c-b455-024cc6e03be3" volumeName="kubernetes.io/secret/020f9532-0954-430c-b455-024cc6e03be3-serving-cert" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104944 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0817ddcd-6f81-4631-a580-bde045d0b712" volumeName="kubernetes.io/empty-dir/0817ddcd-6f81-4631-a580-bde045d0b712-tmp-dir" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104952 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34ad0bf5-0de3-43dc-b13a-6ef480ff447f" volumeName="kubernetes.io/configmap/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-serviceca" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104959 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34ad0bf5-0de3-43dc-b13a-6ef480ff447f" volumeName="kubernetes.io/projected/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-kube-api-access-7gj8t" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104967 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="425863c0-acb7-4822-89c6-2329077e182e" volumeName="kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104978 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4335741f-3c45-4afb-81af-43c072a64c23" volumeName="kubernetes.io/projected/4335741f-3c45-4afb-81af-43c072a64c23-kube-api-access-v5jxb" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.104988 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="708e90f2-a35b-4028-b1e6-8e364d12b86b" volumeName="kubernetes.io/projected/708e90f2-a35b-4028-b1e6-8e364d12b86b-kube-api-access-5hqb6" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105000 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="708e90f2-a35b-4028-b1e6-8e364d12b86b" volumeName="kubernetes.io/secret/708e90f2-a35b-4028-b1e6-8e364d12b86b-serving-cert" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105012 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="79880279-3cc7-450e-b2f1-e52a527be2c0" volumeName="kubernetes.io/projected/79880279-3cc7-450e-b2f1-e52a527be2c0-kube-api-access-8sk2t" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105023 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a985c061-f494-4e9f-998b-d61d83969dd0" volumeName="kubernetes.io/projected/a985c061-f494-4e9f-998b-d61d83969dd0-kube-api-access-scsx9" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105035 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3d9d21b-0ce4-477e-acd2-a26f2e411b89" volumeName="kubernetes.io/projected/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-kube-api-access-8nzms" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105047 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d54597ed-15b3-4939-a362-3f83728cff0f" volumeName="kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-env-overrides" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105059 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="020f9532-0954-430c-b455-024cc6e03be3" volumeName="kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-service-ca-bundle" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105072 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1c89710e-5e4b-491c-84be-7da3dd910513" volumeName="kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-sysctl-allowlist" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105125 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a8d8d3d-560d-4bf0-8160-b18403d85942" volumeName="kubernetes.io/secret/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-key" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105140 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c2be26f-f492-4cb0-a5f1-9840c4ff2437" volumeName="kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-default-certificate" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105153 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3d9d21b-0ce4-477e-acd2-a26f2e411b89" volumeName="kubernetes.io/secret/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-cert" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105168 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="025cb66b-ee01-4a6f-9331-167cb5c214dc" volumeName="kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-cni-binary-copy" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105180 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="425863c0-acb7-4822-89c6-2329077e182e" volumeName="kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105193 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="425863c0-acb7-4822-89c6-2329077e182e" volumeName="kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105206 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a985c061-f494-4e9f-998b-d61d83969dd0" volumeName="kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-etc-tuned" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105218 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d54597ed-15b3-4939-a362-3f83728cff0f" volumeName="kubernetes.io/secret/d54597ed-15b3-4939-a362-3f83728cff0f-ovn-node-metrics-cert" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105230 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8011c9f0-6ebd-4e37-8500-ebf56305e263" volumeName="kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105244 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8011c9f0-6ebd-4e37-8500-ebf56305e263" volumeName="kubernetes.io/projected/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-api-access-lhtqt" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105256 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abda0cb-8e51-4003-942e-27eb6bf88e92" volumeName="kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105268 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" volumeName="kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-config" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105282 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="dd231bc3-ed1b-4516-8327-05de58219655" volumeName="kubernetes.io/projected/dd231bc3-ed1b-4516-8327-05de58219655-kube-api-access-mq9lc" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105293 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0817ddcd-6f81-4631-a580-bde045d0b712" volumeName="kubernetes.io/projected/0817ddcd-6f81-4631-a580-bde045d0b712-kube-api-access-rvlhq" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105305 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8011c9f0-6ebd-4e37-8500-ebf56305e263" volumeName="kubernetes.io/empty-dir/8011c9f0-6ebd-4e37-8500-ebf56305e263-data-volume" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105317 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd" volumeName="kubernetes.io/projected/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-kube-api-access-xqn5h" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105328 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" volumeName="kubernetes.io/secret/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-serving-cert" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105341 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d54597ed-15b3-4939-a362-3f83728cff0f" volumeName="kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-config" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105354 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d54597ed-15b3-4939-a362-3f83728cff0f" volumeName="kubernetes.io/projected/d54597ed-15b3-4939-a362-3f83728cff0f-kube-api-access-lfl2t" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105366 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="020f9532-0954-430c-b455-024cc6e03be3" volumeName="kubernetes.io/projected/020f9532-0954-430c-b455-024cc6e03be3-kube-api-access-kz58h" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105378 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5c2be26f-f492-4cb0-a5f1-9840c4ff2437" volumeName="kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-stats-auth" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105393 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d3290f58-c76c-4996-8bfa-dc0863a18ad5" volumeName="kubernetes.io/projected/d3290f58-c76c-4996-8bfa-dc0863a18ad5-kube-api-access-x7vq4" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105406 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b06c7cb-83c1-4b64-9651-d8be16cd4142" volumeName="kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105420 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b06c7cb-83c1-4b64-9651-d8be16cd4142" volumeName="kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105432 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3e9ac3c3-9b57-4528-94bd-08d35a0c23ed" volumeName="kubernetes.io/projected/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-kube-api-access-4jjj5" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105443 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4a8d8d3d-560d-4bf0-8160-b18403d85942" volumeName="kubernetes.io/projected/4a8d8d3d-560d-4bf0-8160-b18403d85942-kube-api-access-xb5zd" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105455 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a985c061-f494-4e9f-998b-d61d83969dd0" volumeName="kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-tmp" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105467 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="025cb66b-ee01-4a6f-9331-167cb5c214dc" volumeName="kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-daemon-config" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105478 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="425863c0-acb7-4822-89c6-2329077e182e" volumeName="kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105522 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c042d838-3403-46c5-a3af-c86e1702f01d" volumeName="kubernetes.io/projected/c042d838-3403-46c5-a3af-c86e1702f01d-kube-api-access-9g8jc" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105568 5081 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d54597ed-15b3-4939-a362-3f83728cff0f" volumeName="kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-script-lib" seLinuxMountContext="" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105581 5081 reconstruct.go:97] "Volume reconstruction finished" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105588 5081 reconciler.go:29] "Reconciler: start to sync state" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.105830 5081 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:43:02.106702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.106458 5081 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:43:02.111217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.107204 5081 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:43:02.111217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.109323 5081 reconstruct.go:205] "DevicePaths of reconstructed volumes updated" Nov 02 13:43:02.122022 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.122000 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:43:02.122166 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.122005 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:43:02.127359 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.127325 5081 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Nov 02 13:43:02.129057 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.129030 5081 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Nov 02 13:43:02.129057 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.129059 5081 status_manager.go:249] "Starting to sync pod status with apiserver" Nov 02 13:43:02.129227 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.129082 5081 kubelet.go:2521] "Starting kubelet main sync loop" Nov 02 13:43:02.129227 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:02.129124 5081 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Nov 02 13:43:02.133787 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.133765 5081 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161" Nov 02 13:43:02.150232 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.150199 5081 generic.go:356] "Generic (PLEG): container finished" podID="af9bcda821779e795e17c3629099dc04" containerID="83f2bb72b60cea124d10530080a93c5bb6e8d80aa10101773153fff48e9ec2fd" exitCode=0 Nov 02 13:43:02.163963 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.163938 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:43:02.164121 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.163971 5081 generic.go:356] "Generic (PLEG): container finished" podID="9f1e1f78-6650-47b7-bd32-33ff5e2ad398" containerID="1b830d2c560302488607ce97a7b5b02daeb56a1b3a1edab8c5e4e9ea96bb2fe8" exitCode=255 Nov 02 13:43:02.193351 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.193320 5081 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="21eecfee27e9a0bc4fea89a798a6971d4994c8d4b832162505ed0b3055d9e6fe" exitCode=0 Nov 02 13:43:02.193351 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.193347 5081 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="3615d588a6ad5ea488a604c6bf226b7cfa6d012c51747fefed9ae49f310f402c" exitCode=0 Nov 02 13:43:02.193351 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.193354 5081 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="11981df66f5a81d63f620e327b93fa2fd66287ebc0bdef3ccdcb8da1c7449505" exitCode=0 Nov 02 13:43:02.193351 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.193359 5081 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="8509dbed7fde58d2712ec7d31052297b12ef672153fe402dd72982fec2b1620c" exitCode=0 Nov 02 13:43:02.193707 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.193367 5081 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="b6e7f954937fe0be49b26db6c32974889e58922cee9d123e9c09d0d619a3724f" exitCode=0 Nov 02 13:43:02.193707 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.193372 5081 generic.go:356] "Generic (PLEG): container finished" podID="1c89710e-5e4b-491c-84be-7da3dd910513" containerID="a0c45846f4cecdae666f660eca192a903143373d1e11d24d032ac48b63f13a23" exitCode=0 Nov 02 13:43:02.210260 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.210237 5081 manager.go:324] Recovery completed Nov 02 13:43:02.229735 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:02.229705 5081 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet" Nov 02 13:43:02.232248 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232209 5081 cpu_manager.go:226] "Starting" policy="none" Nov 02 13:43:02.232248 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232252 5081 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s" Nov 02 13:43:02.232410 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232273 5081 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory" Nov 02 13:43:02.232681 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232650 5081 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet="" Nov 02 13:43:02.232713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232681 5081 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={} Nov 02 13:43:02.232713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232698 5081 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint" Nov 02 13:43:02.232713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232704 5081 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet="" Nov 02 13:43:02.232713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232710 5081 policy_none.go:50] "Start" Nov 02 13:43:02.232818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232719 5081 memory_manager.go:187] "Starting memorymanager" policy="None" Nov 02 13:43:02.232818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.232728 5081 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Nov 02 13:43:02.246645 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.246623 5081 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint" Nov 02 13:43:02.246699 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.246646 5081 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint" Nov 02 13:43:02.246699 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.246653 5081 policy_none.go:44] "Start" Nov 02 13:43:02.251154 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.251123 5081 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"} Nov 02 13:43:02.253697 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.253680 5081 manager.go:341] "Starting Device Plugin manager" Nov 02 13:43:02.254387 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:02.253707 5081 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Nov 02 13:43:02.254436 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.254395 5081 server.go:87] "Starting device plugin registration server" Nov 02 13:43:02.254762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.254749 5081 eviction_manager.go:194] "Eviction manager: starting control loop" Nov 02 13:43:02.254793 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.254766 5081 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Nov 02 13:43:02.254883 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.254869 5081 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Nov 02 13:43:02.255014 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.254978 5081 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Nov 02 13:43:02.255014 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.255018 5081 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts" Nov 02 13:43:02.255174 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.255023 5081 plugin_manager.go:121] "Starting Kubelet Plugin Manager" Nov 02 13:43:02.255174 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.255069 5081 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-02T13:43:02.255009632Z","UUID":"7c3b6007-0bb6-47e1-9452-297e39266f23","Handler":null,"Name":"","Endpoint":""} Nov 02 13:43:02.256511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.256487 5081 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Nov 02 13:43:02.256511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.256512 5081 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Nov 02 13:43:02.256669 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:02.256635 5081 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Nov 02 13:43:02.355157 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.355071 5081 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach" Nov 02 13:43:02.356484 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.356458 5081 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientMemory" Nov 02 13:43:02.356581 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.356494 5081 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasNoDiskPressure" Nov 02 13:43:02.356581 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.356512 5081 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-60.us-east-2.compute.internal" event="NodeHasSufficientPID" Nov 02 13:43:02.356655 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.356594 5081 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.371755 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.371736 5081 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.371810 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.371801 5081 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.430483 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.430425 5081 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal"] Nov 02 13:43:02.431190 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.431175 5081 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.431240 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.431163 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"af9bcda821779e795e17c3629099dc04","Type":"ContainerStarted","Data":"0b6f744d29fbcae7dae644455aa8c468275eb0d86b1d77f8b712e89ced403e4f"} Nov 02 13:43:02.431240 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.431216 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"af9bcda821779e795e17c3629099dc04","Type":"ContainerDied","Data":"83f2bb72b60cea124d10530080a93c5bb6e8d80aa10101773153fff48e9ec2fd"} Nov 02 13:43:02.431240 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.431224 5081 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.431240 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.431232 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"af9bcda821779e795e17c3629099dc04","Type":"ContainerStarted","Data":"6e5f21db29b557eb418baaf0228cc79085a6dcd8bbb507f06fb5210604d974d5"} Nov 02 13:43:02.431352 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.431263 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"85c2bb7358e6511a88ad994aa6c34739","Type":"ContainerStarted","Data":"94773be405fd208258e41dec426c484253074217e96146e0b5a3f2f6d7721e12"} Nov 02 13:43:02.431352 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.431275 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" event={"ID":"85c2bb7358e6511a88ad994aa6c34739","Type":"ContainerStarted","Data":"c86ca913be368579f669ee3c7351b1bb3b992f45758ac3a20f33edd35411c496"} Nov 02 13:43:02.446001 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.445979 5081 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 13:43:02.446102 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:02.446026 5081 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.446616 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.446603 5081 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 13:43:02.446713 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:02.446642 5081 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.512011 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.511937 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.512011 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.512016 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85c2bb7358e6511a88ad994aa6c34739-config\") pod \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"85c2bb7358e6511a88ad994aa6c34739\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.512189 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.512033 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.612688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.612601 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85c2bb7358e6511a88ad994aa6c34739-config\") pod \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"85c2bb7358e6511a88ad994aa6c34739\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.612688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.612649 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.612688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.612667 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.612915 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.612615 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85c2bb7358e6511a88ad994aa6c34739-config\") pod \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"85c2bb7358e6511a88ad994aa6c34739\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.612915 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.612722 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:02.612915 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:02.612703 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/af9bcda821779e795e17c3629099dc04-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" (UID: \"af9bcda821779e795e17c3629099dc04\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:03.085737 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.085707 5081 apiserver.go:52] "Watching apiserver" Nov 02 13:43:03.101008 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.100981 5081 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Nov 02 13:43:03.101737 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.101711 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-jz2g5","kube-system/kas-connection-checker-685895c7c9-mvmkl","openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf","openshift-multus/multus-bggwr","openshift-service-ca/service-ca-5fffc97bdf-82f9w","openshift-network-diagnostics/network-check-target-xkt2c","openshift-dns/dns-default-dntcg","openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm","openshift-network-operator/iptables-alerter-r9dn5","openshift-multus/multus-additional-cni-plugins-zwb4b","openshift-image-registry/node-ca-ks6n4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8","openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n","openshift-insights/insights-runtime-extractor-k7fhx","openshift-image-registry/image-registry-55d4868459-8zb5p","openshift-image-registry/image-registry-5dc775dc7d-7bvmj","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c","openshift-cluster-node-tuning-operator/tuned-lln8x","openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8","kube-system/kas-connection-checker-685895c7c9-4fnbb","kube-system/kas-connection-checker-685895c7c9-p4shv","openshift-ovn-kubernetes/ovnkube-node-wkwtp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb","openshift-network-console/networking-console-plugin-86c478bb88-62f4x","openshift-ingress-canary/ingress-canary-5jl7s","kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal","openshift-insights/insights-operator-7c4986d449-js5gg","openshift-dns/node-resolver-vgk6w","openshift-ingress/router-default-744d4b8849-b5rwg","openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4","openshift-console-operator/console-operator-7cd56b8dbc-h9df4","openshift-insights/periodic-gathering-lc2vm-gwwjm","kube-system/global-pull-secret-syncer-kkccd","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86","openshift-multus/network-metrics-daemon-xntmf"] Nov 02 13:43:03.103139 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.103117 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.104307 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.104287 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.104762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.104741 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.105202 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.105185 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.107453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.107431 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:43:03.107640 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.107621 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.108220 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.108192 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.108409 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.108389 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.111254 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.111234 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:43:03.112529 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.112509 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\"" Nov 02 13:43:03.112697 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.112680 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Nov 02 13:43:03.112779 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.112680 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.112828 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.112729 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.113280 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.113263 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Nov 02 13:43:03.113358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.113294 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.113358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.113315 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.113483 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.113469 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.113827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.113809 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.114455 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.114439 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.115225 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.115202 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.115308 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.115228 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Nov 02 13:43:03.115308 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.115261 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.115663 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.115651 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.116137 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.116117 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Nov 02 13:43:03.116257 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.116243 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.117455 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.117439 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.118895 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.118879 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.119917 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.119896 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.120094 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.120077 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.121026 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121010 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Nov 02 13:43:03.121114 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121076 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.121114 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121090 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Nov 02 13:43:03.121114 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121102 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Nov 02 13:43:03.121475 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121457 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.121576 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121488 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.121576 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121516 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.121576 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121569 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Nov 02 13:43:03.121719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121657 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Nov 02 13:43:03.121719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121663 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Nov 02 13:43:03.121795 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121722 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.121833 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.121820 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.123137 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.123119 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.123235 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.123139 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.123235 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.123156 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Nov 02 13:43:03.124459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.124426 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Nov 02 13:43:03.124459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.124449 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Nov 02 13:43:03.124574 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.124466 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Nov 02 13:43:03.124718 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.124699 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Nov 02 13:43:03.124779 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.124703 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Nov 02 13:43:03.124779 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.124748 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.125851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.125838 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Nov 02 13:43:03.125851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.125845 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Nov 02 13:43:03.125957 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.125911 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.126038 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.125972 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.126038 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.126004 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.126038 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.126013 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.126273 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.126260 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Nov 02 13:43:03.126316 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.126296 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.126316 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.126305 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.126387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.126340 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Nov 02 13:43:03.126387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.126345 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Nov 02 13:43:03.127223 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127211 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Nov 02 13:43:03.127335 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127322 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.127385 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127376 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.127559 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127526 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.127683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127667 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.127797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127683 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-h4g77\"" Nov 02 13:43:03.127797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127685 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Nov 02 13:43:03.127797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127727 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Nov 02 13:43:03.127797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127737 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-djs2j\"" Nov 02 13:43:03.127797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127745 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8rzz2\"" Nov 02 13:43:03.127797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127739 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-hb687\"" Nov 02 13:43:03.127797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127755 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Nov 02 13:43:03.128062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127814 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Nov 02 13:43:03.128062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127819 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-mlv7f\"" Nov 02 13:43:03.128062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127856 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qngrq\"" Nov 02 13:43:03.128062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.127859 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Nov 02 13:43:03.128939 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.128923 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Nov 02 13:43:03.129070 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.129049 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-n87b2\"" Nov 02 13:43:03.129234 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.129209 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-m5gp5\"" Nov 02 13:43:03.129234 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.129214 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-zltd8\"" Nov 02 13:43:03.129358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.129250 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Nov 02 13:43:03.129358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.129254 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fbcvm\"" Nov 02 13:43:03.129358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.129255 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-s9w2h\"" Nov 02 13:43:03.129358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.129273 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cmphd\"" Nov 02 13:43:03.130373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130357 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cjbpx\"" Nov 02 13:43:03.130454 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130362 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tb7ws\"" Nov 02 13:43:03.130523 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130452 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-tzjbd\"" Nov 02 13:43:03.130641 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130623 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s2t6n\"" Nov 02 13:43:03.130727 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130714 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cfdrs\"" Nov 02 13:43:03.130778 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130724 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Nov 02 13:43:03.130778 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130749 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Nov 02 13:43:03.130778 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.130752 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Nov 02 13:43:03.132174 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.132155 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Nov 02 13:43:03.132267 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.132163 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Nov 02 13:43:03.132267 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.132185 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.132267 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.132202 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Nov 02 13:43:03.133699 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.133680 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.133763 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.133699 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Nov 02 13:43:03.133879 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.133863 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.134064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.134042 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Nov 02 13:43:03.134064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.134056 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sw4zl\"" Nov 02 13:43:03.134231 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.134214 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Nov 02 13:43:03.134362 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.134334 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Nov 02 13:43:03.134454 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.134384 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6w4xj\"" Nov 02 13:43:03.137702 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.137680 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Nov 02 13:43:03.137981 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.137961 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Nov 02 13:43:03.138057 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.138035 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-n56j5\"" Nov 02 13:43:03.138458 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.138438 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Nov 02 13:43:03.138611 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.138589 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-cw7nr\"" Nov 02 13:43:03.138680 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.138658 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.138754 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.138741 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Nov 02 13:43:03.138807 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.138750 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Nov 02 13:43:03.139761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.139740 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5vdjw\"" Nov 02 13:43:03.139861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.139845 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-bscj4\"" Nov 02 13:43:03.140014 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.139992 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Nov 02 13:43:03.140193 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.140172 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-clq6z\"" Nov 02 13:43:03.140768 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.140749 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Nov 02 13:43:03.140844 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.140809 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Nov 02 13:43:03.199581 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.199526 5081 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:03.199750 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.199685 5081 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:03.201253 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.201233 5081 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Nov 02 13:43:03.213845 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.213821 5081 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 13:43:03.213958 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.213865 5081 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:03.214644 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.214627 5081 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Nov 02 13:43:03.214755 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.214671 5081 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-60.us-east-2.compute.internal" Nov 02 13:43:03.216053 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216030 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd231bc3-ed1b-4516-8327-05de58219655-config-volume\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.216131 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216067 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd231bc3-ed1b-4516-8327-05de58219655-tmp-dir\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.216131 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216114 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.216218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216138 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-default-certificate\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.216218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216159 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.216218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216163 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd231bc3-ed1b-4516-8327-05de58219655-tmp-dir\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.216218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216176 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb5zd\" (UniqueName: \"kubernetes.io/projected/4a8d8d3d-560d-4bf0-8160-b18403d85942-kube-api-access-xb5zd\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:43:03.216218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216191 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-trusted-ca\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.216218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216207 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9v6c\" (UniqueName: \"kubernetes.io/projected/c27c165b-51d8-422e-9304-5c9df56cffcd-kube-api-access-l9v6c\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.216608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216270 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.216608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216377 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/dd231bc3-ed1b-4516-8327-05de58219655-config-volume\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.216608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216420 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.216608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216437 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-default-certificate\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.216608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216446 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlqh7\" (UniqueName: \"kubernetes.io/projected/19ea4ba3-7292-4f14-8c78-77cf3cebd95c-kube-api-access-dlqh7\") pod \"migrator-66df5d496b-mq26n\" (UID: \"19ea4ba3-7292-4f14-8c78-77cf3cebd95c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" Nov 02 13:43:03.216608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216493 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvlhq\" (UniqueName: \"kubernetes.io/projected/0817ddcd-6f81-4631-a580-bde045d0b712-kube-api-access-rvlhq\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:43:03.216608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216519 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216623 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gj8t\" (UniqueName: \"kubernetes.io/projected/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-kube-api-access-7gj8t\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216647 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-netns\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216669 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jjj5\" (UniqueName: \"kubernetes.io/projected/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-kube-api-access-4jjj5\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216693 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216725 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-node-log\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216738 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216754 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-netd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216760 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-trusted-ca\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216807 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216846 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216881 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7vq4\" (UniqueName: \"kubernetes.io/projected/d3290f58-c76c-4996-8bfa-dc0863a18ad5-kube-api-access-x7vq4\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216923 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-k8s-cni-cncf-io\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216949 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-system-cni-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.216995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.216978 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0108f6ec-1c16-4842-b63b-40b820bb1867-nginx-conf\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217018 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-var-lib-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217048 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217074 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217083 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-cabundle\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217111 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8011c9f0-6ebd-4e37-8500-ebf56305e263-data-volume\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217136 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-bin\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217161 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfl2t\" (UniqueName: \"kubernetes.io/projected/d54597ed-15b3-4939-a362-3f83728cff0f-kube-api-access-lfl2t\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217191 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8011c9f0-6ebd-4e37-8500-ebf56305e263-data-volume\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217195 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3290f58-c76c-4996-8bfa-dc0863a18ad5-iptables-alerter-script\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217232 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-cabundle\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217244 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0108f6ec-1c16-4842-b63b-40b820bb1867-nginx-conf\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217307 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqb6\" (UniqueName: \"kubernetes.io/projected/708e90f2-a35b-4028-b1e6-8e364d12b86b-kube-api-access-5hqb6\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217351 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217373 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217433 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-systemd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217464 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217466 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217516 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9lc\" (UniqueName: \"kubernetes.io/projected/dd231bc3-ed1b-4516-8327-05de58219655-kube-api-access-mq9lc\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217567 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3290f58-c76c-4996-8bfa-dc0863a18ad5-iptables-alerter-script\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217595 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217636 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfp6x\" (UniqueName: \"kubernetes.io/projected/ece5836e-24ec-4d8d-b607-0fdd65af45a7-kube-api-access-pfp6x\") pod \"kas-connection-checker-685895c7c9-mvmkl\" (UID: \"ece5836e-24ec-4d8d-b607-0fdd65af45a7\") " pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217655 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217672 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.217719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217689 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-etc-tuned\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217761 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-etc-tuned\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217789 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217805 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-device-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217820 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-key\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217840 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-socket-dir-parent\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217877 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-agent-certs\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217909 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217905 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217944 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68t9l\" (UniqueName: \"kubernetes.io/projected/d99fc9f1-2f2f-4049-81ae-172359417cdc-kube-api-access-68t9l\") pod \"network-check-source-6f78d59f99-lmrl4\" (UID: \"d99fc9f1-2f2f-4049-81ae-172359417cdc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217967 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-cnibin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217982 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-cni-binary-copy\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.217998 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-etc-kubernetes\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218017 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-konnectivity-ca\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218053 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnsxj\" (UniqueName: \"kubernetes.io/projected/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda-kube-api-access-cnsxj\") pod \"kas-connection-checker-685895c7c9-p4shv\" (UID: \"4bc533a9-cb34-4ac4-a40d-c32d8cb70eda\") " pod="kube-system/kas-connection-checker-685895c7c9-p4shv" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218084 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218177 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a8d8d3d-560d-4bf0-8160-b18403d85942-signing-key\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218156 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-agent-certs\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218239 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d-konnectivity-ca\") pod \"konnectivity-agent-jz2g5\" (UID: \"fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d\") " pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218236 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218290 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5jxb\" (UniqueName: \"kubernetes.io/projected/4335741f-3c45-4afb-81af-43c072a64c23-kube-api-access-v5jxb\") pod \"kas-connection-checker-685895c7c9-4fnbb\" (UID: \"4335741f-3c45-4afb-81af-43c072a64c23\") " pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218338 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218341 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-cni-binary-copy\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218375 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0817ddcd-6f81-4631-a580-bde045d0b712-hosts-file\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218396 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/020f9532-0954-430c-b455-024cc6e03be3-serving-cert\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218437 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-run\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218471 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-stats-auth\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218515 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sk2t\" (UniqueName: \"kubernetes.io/projected/79880279-3cc7-450e-b2f1-e52a527be2c0-kube-api-access-8sk2t\") pod \"migrator-66df5d496b-x46vf\" (UID: \"79880279-3cc7-450e-b2f1-e52a527be2c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218519 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/020f9532-0954-430c-b455-024cc6e03be3-serving-cert\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218573 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218627 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-socket-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218685 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-stats-auth\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218717 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-registration-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218737 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-hostroot\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218775 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.218871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218810 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218889 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0817ddcd-6f81-4631-a580-bde045d0b712-tmp-dir\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218971 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218973 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0817ddcd-6f81-4631-a580-bde045d0b712-tmp-dir\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.218971 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-multus-certs\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219055 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-dbus\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219086 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-sys-fs\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219107 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-bin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219116 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219135 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l97h\" (UniqueName: \"kubernetes.io/projected/025cb66b-ee01-4a6f-9331-167cb5c214dc-kube-api-access-6l97h\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219168 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219207 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzms\" (UniqueName: \"kubernetes.io/projected/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-kube-api-access-8nzms\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219235 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8011c9f0-6ebd-4e37-8500-ebf56305e263-crio-socket\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219258 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-host\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219283 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mprs\" (UniqueName: \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219298 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219310 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-log-socket\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219358 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysconfig\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219389 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-lib-modules\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219430 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-system-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219458 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxwdg\" (UniqueName: \"kubernetes.io/projected/e6de1ad4-49f8-4b2a-b781-1339bcf825b7-kube-api-access-pxwdg\") pod \"volume-data-source-validator-58c9f5f46d-qw6f8\" (UID: \"e6de1ad4-49f8-4b2a-b781-1339bcf825b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219487 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708e90f2-a35b-4028-b1e6-8e364d12b86b-serving-cert\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219560 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-etc-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219596 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219679 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/708e90f2-a35b-4028-b1e6-8e364d12b86b-serving-cert\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219690 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-serving-cert\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219724 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxfjg\" (UniqueName: \"kubernetes.io/projected/1c89710e-5e4b-491c-84be-7da3dd910513-kube-api-access-sxfjg\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219754 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-snapshots\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219779 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-conf-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219826 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/88248243-f1a3-4b12-a156-78be12e1add9-original-pull-secret\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219828 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219862 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219891 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219946 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-kubelet-config\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219914 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-serving-cert\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.219971 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-systemd\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220022 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220037 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220050 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220050 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220047 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220068 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-snapshots\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220077 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54597ed-15b3-4939-a362-3f83728cff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220187 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-service-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220209 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220308 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-config\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220357 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-sys\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220370 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d54597ed-15b3-4939-a362-3f83728cff0f-ovn-node-metrics-cert\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220374 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-service-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.220387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220401 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scsx9\" (UniqueName: \"kubernetes.io/projected/a985c061-f494-4e9f-998b-d61d83969dd0-kube-api-access-scsx9\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220428 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220555 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqn5h\" (UniqueName: \"kubernetes.io/projected/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-kube-api-access-xqn5h\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220597 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-ovn\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220613 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-config\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220629 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220646 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-daemon-config\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220664 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220688 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-cnibin\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220713 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-host\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220735 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-cert\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220775 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-tmp\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220834 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-daemon-config\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220874 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220875 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/020f9532-0954-430c-b455-024cc6e03be3-tmp\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220917 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6f2c\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220938 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-cert\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220946 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4fn\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220962 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.220983 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhtqt\" (UniqueName: \"kubernetes.io/projected/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-api-access-lhtqt\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221026 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221052 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221082 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708e90f2-a35b-4028-b1e6-8e364d12b86b-config\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221121 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-systemd-units\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221152 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221121 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221188 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69kk\" (UniqueName: \"kubernetes.io/projected/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-kube-api-access-c69kk\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221279 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/708e90f2-a35b-4028-b1e6-8e364d12b86b-config\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221301 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-modprobe-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221324 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1c89710e-5e4b-491c-84be-7da3dd910513-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221334 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g8jc\" (UniqueName: \"kubernetes.io/projected/c042d838-3403-46c5-a3af-c86e1702f01d-kube-api-access-9g8jc\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221452 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221485 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-serviceca\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221559 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-var-lib-kubelet\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221593 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-tmp\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221622 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/396ce5b5-d0e0-4200-8332-faed8c96a7ae-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221649 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-netns\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221677 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-config\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221677 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a985c061-f494-4e9f-998b-d61d83969dd0-tmp\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221708 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-script-lib\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221719 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-serviceca\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221737 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221763 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-kubelet\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221788 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbh4\" (UniqueName: \"kubernetes.io/projected/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-kube-api-access-wjbh4\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221806 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221814 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccgxh\" (UniqueName: \"kubernetes.io/projected/396ce5b5-d0e0-4200-8332-faed8c96a7ae-kube-api-access-ccgxh\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221843 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-slash\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221868 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-kubernetes\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221896 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3290f58-c76c-4996-8bfa-dc0863a18ad5-host-slash\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221897 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-config\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221911 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/396ce5b5-d0e0-4200-8332-faed8c96a7ae-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221915 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-ovnkube-script-lib\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221922 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221968 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.221962 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-env-overrides\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222013 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222097 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d54597ed-15b3-4939-a362-3f83728cff0f-env-overrides\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222109 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222144 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-conf\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222175 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222183 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-kubelet\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222225 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222266 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222293 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222321 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz58h\" (UniqueName: \"kubernetes.io/projected/020f9532-0954-430c-b455-024cc6e03be3-kube-api-access-kz58h\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.222459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222345 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-multus\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.224226 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222518 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:43:03.224226 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.222621 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/020f9532-0954-430c-b455-024cc6e03be3-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.234362 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.234338 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jjj5\" (UniqueName: \"kubernetes.io/projected/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-kube-api-access-4jjj5\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.235655 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.235638 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb5zd\" (UniqueName: \"kubernetes.io/projected/4a8d8d3d-560d-4bf0-8160-b18403d85942-kube-api-access-xb5zd\") pod \"service-ca-5fffc97bdf-82f9w\" (UID: \"4a8d8d3d-560d-4bf0-8160-b18403d85942\") " pod="openshift-service-ca/service-ca-5fffc97bdf-82f9w" Nov 02 13:43:03.235982 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.235963 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9lc\" (UniqueName: \"kubernetes.io/projected/dd231bc3-ed1b-4516-8327-05de58219655-kube-api-access-mq9lc\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.236511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.236495 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mprs\" (UniqueName: \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\") pod \"periodic-gathering-lc2vm-gwwjm\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:43:03.237004 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.236966 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5jxb\" (UniqueName: \"kubernetes.io/projected/4335741f-3c45-4afb-81af-43c072a64c23-kube-api-access-v5jxb\") pod \"kas-connection-checker-685895c7c9-4fnbb\" (UID: \"4335741f-3c45-4afb-81af-43c072a64c23\") " pod="kube-system/kas-connection-checker-685895c7c9-4fnbb" Nov 02 13:43:03.237004 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.236999 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnsxj\" (UniqueName: \"kubernetes.io/projected/4bc533a9-cb34-4ac4-a40d-c32d8cb70eda-kube-api-access-cnsxj\") pod \"kas-connection-checker-685895c7c9-p4shv\" (UID: \"4bc533a9-cb34-4ac4-a40d-c32d8cb70eda\") " pod="kube-system/kas-connection-checker-685895c7c9-p4shv" Nov 02 13:43:03.237255 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.237237 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9v6c\" (UniqueName: \"kubernetes.io/projected/c27c165b-51d8-422e-9304-5c9df56cffcd-kube-api-access-l9v6c\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.237307 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.237273 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzms\" (UniqueName: \"kubernetes.io/projected/b3d9d21b-0ce4-477e-acd2-a26f2e411b89-kube-api-access-8nzms\") pod \"ingress-canary-5jl7s\" (UID: \"b3d9d21b-0ce4-477e-acd2-a26f2e411b89\") " pod="openshift-ingress-canary/ingress-canary-5jl7s" Nov 02 13:43:03.237475 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.237454 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfp6x\" (UniqueName: \"kubernetes.io/projected/ece5836e-24ec-4d8d-b607-0fdd65af45a7-kube-api-access-pfp6x\") pod \"kas-connection-checker-685895c7c9-mvmkl\" (UID: \"ece5836e-24ec-4d8d-b607-0fdd65af45a7\") " pod="kube-system/kas-connection-checker-685895c7c9-mvmkl" Nov 02 13:43:03.237634 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.237618 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlqh7\" (UniqueName: \"kubernetes.io/projected/19ea4ba3-7292-4f14-8c78-77cf3cebd95c-kube-api-access-dlqh7\") pod \"migrator-66df5d496b-mq26n\" (UID: \"19ea4ba3-7292-4f14-8c78-77cf3cebd95c\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-mq26n" Nov 02 13:43:03.237634 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.237626 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7vq4\" (UniqueName: \"kubernetes.io/projected/d3290f58-c76c-4996-8bfa-dc0863a18ad5-kube-api-access-x7vq4\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:43:03.237912 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.237896 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxwdg\" (UniqueName: \"kubernetes.io/projected/e6de1ad4-49f8-4b2a-b781-1339bcf825b7-kube-api-access-pxwdg\") pod \"volume-data-source-validator-58c9f5f46d-qw6f8\" (UID: \"e6de1ad4-49f8-4b2a-b781-1339bcf825b7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-qw6f8" Nov 02 13:43:03.239778 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.239762 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvlhq\" (UniqueName: \"kubernetes.io/projected/0817ddcd-6f81-4631-a580-bde045d0b712-kube-api-access-rvlhq\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:43:03.242064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.242048 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxfjg\" (UniqueName: \"kubernetes.io/projected/1c89710e-5e4b-491c-84be-7da3dd910513-kube-api-access-sxfjg\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.242255 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.242236 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcbqw\" (UniqueName: \"kubernetes.io/projected/af544062-fa2e-4ef5-b2c5-a849d8c5c109-kube-api-access-lcbqw\") pod \"network-check-target-xkt2c\" (UID: \"af544062-fa2e-4ef5-b2c5-a849d8c5c109\") " pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:43:03.242397 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.242382 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.242471 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.242457 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqb6\" (UniqueName: \"kubernetes.io/projected/708e90f2-a35b-4028-b1e6-8e364d12b86b-kube-api-access-5hqb6\") pod \"service-ca-operator-544d749c8c-k2xv8\" (UID: \"708e90f2-a35b-4028-b1e6-8e364d12b86b\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" Nov 02 13:43:03.242932 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.242918 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sk2t\" (UniqueName: \"kubernetes.io/projected/79880279-3cc7-450e-b2f1-e52a527be2c0-kube-api-access-8sk2t\") pod \"migrator-66df5d496b-x46vf\" (UID: \"79880279-3cc7-450e-b2f1-e52a527be2c0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-x46vf" Nov 02 13:43:03.243709 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.243690 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scsx9\" (UniqueName: \"kubernetes.io/projected/a985c061-f494-4e9f-998b-d61d83969dd0-kube-api-access-scsx9\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.243770 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.243731 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g8jc\" (UniqueName: \"kubernetes.io/projected/c042d838-3403-46c5-a3af-c86e1702f01d-kube-api-access-9g8jc\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:43:03.243802 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.243774 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6f2c\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.243843 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.243823 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz58h\" (UniqueName: \"kubernetes.io/projected/020f9532-0954-430c-b455-024cc6e03be3-kube-api-access-kz58h\") pod \"insights-operator-7c4986d449-js5gg\" (UID: \"020f9532-0954-430c-b455-024cc6e03be3\") " pod="openshift-insights/insights-operator-7c4986d449-js5gg" Nov 02 13:43:03.243874 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.243841 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68t9l\" (UniqueName: \"kubernetes.io/projected/d99fc9f1-2f2f-4049-81ae-172359417cdc-kube-api-access-68t9l\") pod \"network-check-source-6f78d59f99-lmrl4\" (UID: \"d99fc9f1-2f2f-4049-81ae-172359417cdc\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-lmrl4" Nov 02 13:43:03.244526 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.244510 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccgxh\" (UniqueName: \"kubernetes.io/projected/396ce5b5-d0e0-4200-8332-faed8c96a7ae-kube-api-access-ccgxh\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.245779 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.245764 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqn5h\" (UniqueName: \"kubernetes.io/projected/8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd-kube-api-access-xqn5h\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-bw79c\" (UID: \"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" Nov 02 13:43:03.246389 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.246371 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbh4\" (UniqueName: \"kubernetes.io/projected/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-kube-api-access-wjbh4\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.247113 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.247087 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l97h\" (UniqueName: \"kubernetes.io/projected/025cb66b-ee01-4a6f-9331-167cb5c214dc-kube-api-access-6l97h\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.247242 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.247228 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfl2t\" (UniqueName: \"kubernetes.io/projected/d54597ed-15b3-4939-a362-3f83728cff0f-kube-api-access-lfl2t\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.247730 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.247713 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.249586 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.249567 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhtqt\" (UniqueName: \"kubernetes.io/projected/8011c9f0-6ebd-4e37-8500-ebf56305e263-kube-api-access-lhtqt\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.249682 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.249668 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69kk\" (UniqueName: \"kubernetes.io/projected/9f1e1f78-6650-47b7-bd32-33ff5e2ad398-kube-api-access-c69kk\") pod \"console-operator-7cd56b8dbc-h9df4\" (UID: \"9f1e1f78-6650-47b7-bd32-33ff5e2ad398\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:03.250238 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.250222 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4fn\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.250876 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.250857 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gj8t\" (UniqueName: \"kubernetes.io/projected/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-kube-api-access-7gj8t\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:43:03.323594 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323525 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-registration-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323607 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-hostroot\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323637 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-multus-certs\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323650 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-registration-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323660 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-dbus\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323693 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-sys-fs\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323710 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-bin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323714 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-multus-certs\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323717 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-hostroot\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323733 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8011c9f0-6ebd-4e37-8500-ebf56305e263-crio-socket\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.323761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323756 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-host\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323782 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-log-socket\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323788 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-bin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323783 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-sys-fs\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323820 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-log-socket\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323776 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-dbus\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323838 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8011c9f0-6ebd-4e37-8500-ebf56305e263-crio-socket\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323862 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-host\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323874 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysconfig\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323897 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-lib-modules\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323925 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-system-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323956 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-etc-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323983 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-conf-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.323994 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysconfig\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324001 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-lib-modules\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324009 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-system-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324012 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-kubelet-config\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324040 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-systemd\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324044 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-etc-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324039 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-conf-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324058 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324058 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/88248243-f1a3-4b12-a156-78be12e1add9-kubelet-config\") pod \"global-pull-secret-syncer-kkccd\" (UID: \"88248243-f1a3-4b12-a156-78be12e1add9\") " pod="kube-system/global-pull-secret-syncer-kkccd" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324083 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-systemd\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324081 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-sys\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324107 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324117 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324122 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-ovn\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324127 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-sys\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324154 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-ovn\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324160 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324185 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-cnibin\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324200 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-host\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324219 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.324217 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324242 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-systemd-units\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324260 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-cnibin\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324267 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324265 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34ad0bf5-0de3-43dc-b13a-6ef480ff447f-host\") pod \"node-ca-ks6n4\" (UID: \"34ad0bf5-0de3-43dc-b13a-6ef480ff447f\") " pod="openshift-image-registry/node-ca-ks6n4" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324292 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-modprobe-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324317 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324294 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-systemd-units\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324376 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-modprobe-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324402 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-var-lib-kubelet\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.324414 5081 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324481 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-netns\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324487 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-var-lib-kubelet\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.324504 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:03.824480009 +0000 UTC m=+1.816868305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : configmap references non-existent config key: service-ca.crt Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324515 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-d\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324559 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-netns\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.324554 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:03.824524272 +0000 UTC m=+1.816912541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324605 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-kubelet\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324594 5081 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324657 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-slash\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324662 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-kubelet\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.324633 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-slash\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325163 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-kubernetes\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325204 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3290f58-c76c-4996-8bfa-dc0863a18ad5-host-slash\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325237 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-kubernetes\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325240 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325296 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.325323 5081 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.325386 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:03.825363456 +0000 UTC m=+1.817751720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:43:03.325434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325434 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3290f58-c76c-4996-8bfa-dc0863a18ad5-host-slash\") pod \"iptables-alerter-r9dn5\" (UID: \"d3290f58-c76c-4996-8bfa-dc0863a18ad5\") " pod="openshift-network-operator/iptables-alerter-r9dn5" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325453 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-conf\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325560 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-etc-sysctl-conf\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325594 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-kubelet\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325619 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325651 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-multus\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325686 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325717 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325743 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-netns\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325772 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-node-log\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325802 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-netd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325859 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-netns\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325890 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325907 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-cni-multus\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.325935 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325943 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-netd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.325865 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-node-log\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.325949 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326000 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.326025 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:43:03.826003856 +0000 UTC m=+1.818392135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326053 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-cni-dir\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326057 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-k8s-cni-cncf-io\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326092 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-system-cni-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326097 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-var-lib-kubelet\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326126 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-var-lib-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326158 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-host-run-k8s-cni-cncf-io\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326159 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-bin\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326196 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-cni-bin\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326201 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-systemd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326240 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-systemd\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326240 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326284 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326316 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1c89710e-5e4b-491c-84be-7da3dd910513-system-cni-dir\") pod \"multus-additional-cni-plugins-zwb4b\" (UID: \"1c89710e-5e4b-491c-84be-7da3dd910513\") " pod="openshift-multus/multus-additional-cni-plugins-zwb4b" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326285 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-var-lib-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326318 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326370 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-device-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326387 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326402 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-socket-dir-parent\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326436 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326438 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326484 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-host-run-ovn-kubernetes\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326492 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d54597ed-15b3-4939-a362-3f83728cff0f-run-openvswitch\") pod \"ovnkube-node-wkwtp\" (UID: \"d54597ed-15b3-4939-a362-3f83728cff0f\") " pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326517 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-cnibin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326571 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-etc-kubernetes\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326583 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-device-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326602 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326635 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326644 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-cnibin\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326699 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-multus-socket-dir-parent\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326731 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0817ddcd-6f81-4631-a580-bde045d0b712-hosts-file\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326764 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-run\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326812 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-socket-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.326965 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c27c165b-51d8-422e-9304-5c9df56cffcd-socket-dir\") pod \"aws-ebs-csi-driver-node-jfvdb\" (UID: \"c27c165b-51d8-422e-9304-5c9df56cffcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jfvdb" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.327020 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/025cb66b-ee01-4a6f-9331-167cb5c214dc-etc-kubernetes\") pod \"multus-bggwr\" (UID: \"025cb66b-ee01-4a6f-9331-167cb5c214dc\") " pod="openshift-multus/multus-bggwr" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.327113 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0817ddcd-6f81-4631-a580-bde045d0b712-hosts-file\") pod \"node-resolver-vgk6w\" (UID: \"0817ddcd-6f81-4631-a580-bde045d0b712\") " pod="openshift-dns/node-resolver-vgk6w" Nov 02 13:43:03.327337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.327216 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a985c061-f494-4e9f-998b-d61d83969dd0-run\") pod \"tuned-lln8x\" (UID: \"a985c061-f494-4e9f-998b-d61d83969dd0\") " pod="openshift-cluster-node-tuning-operator/tuned-lln8x" Nov 02 13:43:03.329664 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.327387 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:03.329664 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.327402 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:43:03.329664 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.327653 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:03.827634587 +0000 UTC m=+1.820022863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:43:03.329664 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.329383 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e9ac3c3-9b57-4528-94bd-08d35a0c23ed-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-v6p86\" (UID: \"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.332995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.331251 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0108f6ec-1c16-4842-b63b-40b820bb1867-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-62f4x\" (UID: \"0108f6ec-1c16-4842-b63b-40b820bb1867\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:43:03.332995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.331592 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/396ce5b5-d0e0-4200-8332-faed8c96a7ae-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-pnhbm\" (UID: \"396ce5b5-d0e0-4200-8332-faed8c96a7ae\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.332995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.331597 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c042d838-3403-46c5-a3af-c86e1702f01d-metrics-certs\") pod \"network-metrics-daemon-xntmf\" (UID: \"c042d838-3403-46c5-a3af-c86e1702f01d\") " pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:43:03.332995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.332925 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/dd231bc3-ed1b-4516-8327-05de58219655-metrics-tls\") pod \"dns-default-dntcg\" (UID: \"dd231bc3-ed1b-4516-8327-05de58219655\") " pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.403700 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.403678 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" Nov 02 13:43:03.405430 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.405411 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" Nov 02 13:43:03.406610 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.406595 5081 scope.go:122] "RemoveContainer" containerID="1b830d2c560302488607ce97a7b5b02daeb56a1b3a1edab8c5e4e9ea96bb2fe8" Nov 02 13:43:03.407678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.407662 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" Nov 02 13:43:03.412435 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.412419 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xntmf" Nov 02 13:43:03.420174 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.420154 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:03.704797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.704710 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86"] Nov 02 13:43:03.746405 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.746387 5081 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 13:43:03.779055 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.779032 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm"] Nov 02 13:43:03.781351 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:03.781311 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396ce5b5_d0e0_4200_8332_faed8c96a7ae.slice/crio-7b72507e771bc2979b4b258648b1b620c53e14a647a795f0779960ff08768458 WatchSource:0}: Error finding container 7b72507e771bc2979b4b258648b1b620c53e14a647a795f0779960ff08768458: Status 404 returned error can't find the container with id 7b72507e771bc2979b4b258648b1b620c53e14a647a795f0779960ff08768458 Nov 02 13:43:03.785881 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.785821 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dntcg"] Nov 02 13:43:03.789018 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:03.788995 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd231bc3_ed1b_4516_8327_05de58219655.slice/crio-95de34c5c86b51149eb29446e64e0db0501606dab368930a0efc0f11f8348149 WatchSource:0}: Error finding container 95de34c5c86b51149eb29446e64e0db0501606dab368930a0efc0f11f8348149: Status 404 returned error can't find the container with id 95de34c5c86b51149eb29446e64e0db0501606dab368930a0efc0f11f8348149 Nov 02 13:43:03.832086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.832051 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:03.832232 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.832094 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.832232 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.832120 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:03.832232 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.832141 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:03.832232 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.832177 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:03.832347 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832278 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:03.832347 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832289 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:43:03.832347 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832331 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:04.832318904 +0000 UTC m=+2.824707179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:43:03.832683 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832659 5081 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:43:03.832832 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832691 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:03.832832 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832713 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:43:03.832832 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832716 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:04.832701989 +0000 UTC m=+2.825090253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:43:03.832832 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832771 5081 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:43:03.832832 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832777 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:43:04.832760341 +0000 UTC m=+2.825148615 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:43:03.832832 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832807 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:04.83279628 +0000 UTC m=+2.825184557 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:43:03.832832 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:03.832827 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:04.832816011 +0000 UTC m=+2.825204287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : configmap references non-existent config key: service-ca.crt Nov 02 13:43:03.837201 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.837173 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-62f4x"] Nov 02 13:43:03.837306 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.837242 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xntmf"] Nov 02 13:43:03.845636 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:03.845508 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:04.207348 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.207313 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" event={"ID":"0108f6ec-1c16-4842-b63b-40b820bb1867","Type":"ContainerStarted","Data":"84dfc59cbf353741820efef46bc8e90171e500ed00de8516a340c5bfb3485a29"} Nov 02 13:43:04.208452 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.208429 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xntmf" event={"ID":"c042d838-3403-46c5-a3af-c86e1702f01d","Type":"ContainerStarted","Data":"e7fd5825976f7664057a74cfd69c72f67f9d4b40e4c8d70b0db5d3c28790121f"} Nov 02 13:43:04.209544 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.209514 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dntcg" event={"ID":"dd231bc3-ed1b-4516-8327-05de58219655","Type":"ContainerStarted","Data":"95de34c5c86b51149eb29446e64e0db0501606dab368930a0efc0f11f8348149"} Nov 02 13:43:04.210623 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.210606 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" event={"ID":"396ce5b5-d0e0-4200-8332-faed8c96a7ae","Type":"ContainerStarted","Data":"7b72507e771bc2979b4b258648b1b620c53e14a647a795f0779960ff08768458"} Nov 02 13:43:04.211676 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.211656 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" event={"ID":"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed","Type":"ContainerStarted","Data":"dc7fc5d07f2064a147d7fd00393be356064ebfef71954d820cba08f96eb98f34"} Nov 02 13:43:04.213319 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.213304 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:43:04.213414 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.213368 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" event={"ID":"9f1e1f78-6650-47b7-bd32-33ff5e2ad398","Type":"ContainerStarted","Data":"28bd2eba077c47ffa3448fe5829ab5f59f142be2e8c49fc7c9cc4476555a15e0"} Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.845004 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.845055 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.845093 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.845129 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.845297 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.845472 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.845490 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.845566 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:06.845531092 +0000 UTC m=+4.837935285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.845986 5081 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.846055 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:06.846021963 +0000 UTC m=+4.838410225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:04.846748 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-service-ca-bundle\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.846937 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.846952 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:43:04.847026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.847001 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:43:06.846984571 +0000 UTC m=+4.839372836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:43:04.848018 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.847919 5081 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:43:04.848018 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:04.847993 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:06.847977853 +0000 UTC m=+4.840366120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:43:06.204633 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.204606 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:06.204966 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.204725 5081 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 13:43:06.210730 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.210699 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-h9df4" Nov 02 13:43:06.225592 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.225567 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-62f4x" event={"ID":"0108f6ec-1c16-4842-b63b-40b820bb1867","Type":"ContainerStarted","Data":"ce7fc64189913fcba7843d5f3d688da038007b6d956e14484b5197472fb16ddc"} Nov 02 13:43:06.228893 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.228870 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xntmf" event={"ID":"c042d838-3403-46c5-a3af-c86e1702f01d","Type":"ContainerStarted","Data":"24237baff15f64d8ae95002d5c1db7fc0c9848e19337f3daeb34c43cc72c4603"} Nov 02 13:43:06.229015 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.228907 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xntmf" event={"ID":"c042d838-3403-46c5-a3af-c86e1702f01d","Type":"ContainerStarted","Data":"97d24b220ea224125f9f5b16853758ef870509e63b39dc827ab6dcb82141e42b"} Nov 02 13:43:06.866112 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.866011 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:06.866112 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.866084 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.866126 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866167 5081 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:06.866186 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866231 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls podName:8011c9f0-6ebd-4e37-8500-ebf56305e263 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:10.866214325 +0000 UTC m=+8.858602587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k7fhx" (UID: "8011c9f0-6ebd-4e37-8500-ebf56305e263") : secret "insights-runtime-extractor-tls" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866237 5081 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866285 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866298 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs podName:5c2be26f-f492-4cb0-a5f1-9840c4ff2437 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:10.86628006 +0000 UTC m=+8.858668343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs") pod "router-default-744d4b8849-b5rwg" (UID: "5c2be26f-f492-4cb0-a5f1-9840c4ff2437") : secret "router-metrics-certs-default" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866298 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55d4868459-8zb5p: secret "image-registry-tls" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866310 5081 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866330 5081 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc775dc7d-7bvmj: secret "image-registry-tls" not found Nov 02 13:43:06.866331 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866338 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls podName:0b06c7cb-83c1-4b64-9651-d8be16cd4142 nodeName:}" failed. No retries permitted until 2026-11-02 13:43:10.866327446 +0000 UTC m=+8.858715743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls") pod "image-registry-55d4868459-8zb5p" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142") : secret "image-registry-tls" not found Nov 02 13:43:06.866727 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:06.866374 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls podName:425863c0-acb7-4822-89c6-2329077e182e nodeName:}" failed. No retries permitted until 2026-11-02 13:43:10.866359 +0000 UTC m=+8.858747285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls") pod "image-registry-5dc775dc7d-7bvmj" (UID: "425863c0-acb7-4822-89c6-2329077e182e") : secret "image-registry-tls" not found Nov 02 13:43:07.234037 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.234003 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dntcg" event={"ID":"dd231bc3-ed1b-4516-8327-05de58219655","Type":"ContainerStarted","Data":"6f491b67b1cdb73e5a1e9f573ae9c353918376405fd8c59a7a117614ae9dfa63"} Nov 02 13:43:07.234456 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.234080 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dntcg" event={"ID":"dd231bc3-ed1b-4516-8327-05de58219655","Type":"ContainerStarted","Data":"e2ae82546f4095a67231b6037c08d62fce9b30a1ed96228251c047481658369f"} Nov 02 13:43:07.234456 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.234128 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:07.235701 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.235670 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-pnhbm" event={"ID":"396ce5b5-d0e0-4200-8332-faed8c96a7ae","Type":"ContainerStarted","Data":"45a35096b9dce8226d620d09216b95d204a3907ce9354428b1d9f45666d8fefb"} Nov 02 13:43:07.237411 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.237391 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" event={"ID":"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed","Type":"ContainerStarted","Data":"9f114e4e727d4ca2be270112603ad9c4762e101e7da087fb5683140edeebb963"} Nov 02 13:43:07.237490 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.237435 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-v6p86" event={"ID":"3e9ac3c3-9b57-4528-94bd-08d35a0c23ed","Type":"ContainerStarted","Data":"bc7718bb406133bdf412cf05dff87317a8bdbb29eceb95140d667372d7501d84"} Nov 02 13:43:07.238912 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.238892 5081 generic.go:356] "Generic (PLEG): container finished" podID="8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd" containerID="d2243f9e42a6cbff1452305f60b3fbc790964e901de5ee965893c9819f99198a" exitCode=0 Nov 02 13:43:07.238985 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.238962 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" event={"ID":"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd","Type":"ContainerDied","Data":"d2243f9e42a6cbff1452305f60b3fbc790964e901de5ee965893c9819f99198a"} Nov 02 13:43:07.239479 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.239460 5081 scope.go:122] "RemoveContainer" containerID="d2243f9e42a6cbff1452305f60b3fbc790964e901de5ee965893c9819f99198a" Nov 02 13:43:07.448856 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.448828 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:07.449048 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:07.449034 5081 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 13:43:08.244241 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:08.244203 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-bw79c" event={"ID":"8c05d6ad-1e03-4cf4-9bab-c3a89c8913dd","Type":"ContainerStarted","Data":"9b2b92dea17f41a4fc7e476a7df9af4cbb26667910a735e2246ae53b1d1d88d2"} Nov 02 13:43:09.746733 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:09.746692 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:43:10.903334 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.903299 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:10.903334 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.903338 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:10.903817 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.903373 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:10.903817 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.903414 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:10.906372 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.906332 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"image-registry-55d4868459-8zb5p\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:10.906372 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.906366 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c2be26f-f492-4cb0-a5f1-9840c4ff2437-metrics-certs\") pod \"router-default-744d4b8849-b5rwg\" (UID: \"5c2be26f-f492-4cb0-a5f1-9840c4ff2437\") " pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:10.906519 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.906474 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"image-registry-5dc775dc7d-7bvmj\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:10.907325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.907310 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8011c9f0-6ebd-4e37-8500-ebf56305e263-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k7fhx\" (UID: \"8011c9f0-6ebd-4e37-8500-ebf56305e263\") " pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:10.918362 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.918344 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:10.922077 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:10.922057 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k7fhx" Nov 02 13:43:11.202946 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.202909 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k7fhx"] Nov 02 13:43:11.205725 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.205697 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:11.205832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.205750 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55d4868459-8zb5p"] Nov 02 13:43:11.205832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.205773 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:11.207433 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:11.207406 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8011c9f0_6ebd_4e37_8500_ebf56305e263.slice/crio-233b67a585d3ef2deb3d709095aa9505a440f67441ed397851bdc6a5df92ff7d WatchSource:0}: Error finding container 233b67a585d3ef2deb3d709095aa9505a440f67441ed397851bdc6a5df92ff7d: Status 404 returned error can't find the container with id 233b67a585d3ef2deb3d709095aa9505a440f67441ed397851bdc6a5df92ff7d Nov 02 13:43:11.208670 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:11.208648 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b06c7cb_83c1_4b64_9651_d8be16cd4142.slice/crio-0a1628ae48ddf67f10e13e56416ce93604bfba59b15e102ef857123a7fa09255 WatchSource:0}: Error finding container 0a1628ae48ddf67f10e13e56416ce93604bfba59b15e102ef857123a7fa09255: Status 404 returned error can't find the container with id 0a1628ae48ddf67f10e13e56416ce93604bfba59b15e102ef857123a7fa09255 Nov 02 13:43:11.274040 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.274001 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" event={"ID":"0b06c7cb-83c1-4b64-9651-d8be16cd4142","Type":"ContainerStarted","Data":"0a1628ae48ddf67f10e13e56416ce93604bfba59b15e102ef857123a7fa09255"} Nov 02 13:43:11.278550 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.278442 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7fhx" event={"ID":"8011c9f0-6ebd-4e37-8500-ebf56305e263","Type":"ContainerStarted","Data":"233b67a585d3ef2deb3d709095aa9505a440f67441ed397851bdc6a5df92ff7d"} Nov 02 13:43:11.508346 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.508206 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-744d4b8849-b5rwg"] Nov 02 13:43:11.511000 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:11.510969 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2be26f_f492_4cb0_a5f1_9840c4ff2437.slice/crio-ef041502e54abd1fe7d8cf4f21ece7bdbac0a120c8f823eecef15a36e76026cb WatchSource:0}: Error finding container ef041502e54abd1fe7d8cf4f21ece7bdbac0a120c8f823eecef15a36e76026cb: Status 404 returned error can't find the container with id ef041502e54abd1fe7d8cf4f21ece7bdbac0a120c8f823eecef15a36e76026cb Nov 02 13:43:11.511124 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:11.511045 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc775dc7d-7bvmj"] Nov 02 13:43:11.513823 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:11.513791 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425863c0_acb7_4822_89c6_2329077e182e.slice/crio-6b2ee97003de2280b10c988dd487f0d4bbab83b36d4ed856e4e0ba4047454c0d WatchSource:0}: Error finding container 6b2ee97003de2280b10c988dd487f0d4bbab83b36d4ed856e4e0ba4047454c0d: Status 404 returned error can't find the container with id 6b2ee97003de2280b10c988dd487f0d4bbab83b36d4ed856e4e0ba4047454c0d Nov 02 13:43:12.284654 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:12.284620 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" event={"ID":"0b06c7cb-83c1-4b64-9651-d8be16cd4142","Type":"ContainerStarted","Data":"926122024e74905c7f4b29cb36085e3ce2838f7a4092bbc96b22a2941a1b6518"} Nov 02 13:43:12.286294 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:12.286227 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-744d4b8849-b5rwg" event={"ID":"5c2be26f-f492-4cb0-a5f1-9840c4ff2437","Type":"ContainerStarted","Data":"8110d46804c7f366fea8381572386fe597a7421f7a1d41f9de597ab8f0bfc26e"} Nov 02 13:43:12.286294 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:12.286277 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-744d4b8849-b5rwg" event={"ID":"5c2be26f-f492-4cb0-a5f1-9840c4ff2437","Type":"ContainerStarted","Data":"ef041502e54abd1fe7d8cf4f21ece7bdbac0a120c8f823eecef15a36e76026cb"} Nov 02 13:43:12.288038 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:12.288016 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7fhx" event={"ID":"8011c9f0-6ebd-4e37-8500-ebf56305e263","Type":"ContainerStarted","Data":"d6552937eeb1e64b1bd42f788c5a0fa44a96cf77692af713422569cdc91b59d5"} Nov 02 13:43:12.288121 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:12.288063 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7fhx" event={"ID":"8011c9f0-6ebd-4e37-8500-ebf56305e263","Type":"ContainerStarted","Data":"95814d6c44e3abc6916ed1f85960677c19443cdeb86bec9589580f338f4bb43c"} Nov 02 13:43:12.289411 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:12.289391 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" event={"ID":"425863c0-acb7-4822-89c6-2329077e182e","Type":"ContainerStarted","Data":"f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f"} Nov 02 13:43:12.289493 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:12.289430 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" event={"ID":"425863c0-acb7-4822-89c6-2329077e182e","Type":"ContainerStarted","Data":"6b2ee97003de2280b10c988dd487f0d4bbab83b36d4ed856e4e0ba4047454c0d"} Nov 02 13:43:13.197173 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:13.197131 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wkwtp" Nov 02 13:43:13.205985 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:13.205956 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:13.209337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:13.209307 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:13.294763 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:13.294728 5081 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 13:43:13.294763 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:13.294728 5081 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 13:43:13.572854 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:13.572778 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:13.574131 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:13.574107 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-744d4b8849-b5rwg" Nov 02 13:43:14.300793 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:14.300757 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k7fhx" event={"ID":"8011c9f0-6ebd-4e37-8500-ebf56305e263","Type":"ContainerStarted","Data":"2882ed86a471bea8c2fa4b0d8b56a7413126a062527a7b345ef4bd49060fdfdb"} Nov 02 13:43:16.083062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.083029 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb"] Nov 02 13:43:16.086517 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.086502 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" Nov 02 13:43:16.089162 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.089138 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dc775dc7d-7bvmj"] Nov 02 13:43:16.089458 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.089445 5081 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness" Nov 02 13:43:16.111122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.111088 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-c5mz4\"" Nov 02 13:43:16.117525 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.117502 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb"] Nov 02 13:43:16.138978 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.138952 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-dh8qv"] Nov 02 13:43:16.142166 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.142143 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-569dd4f648-mvjn9"] Nov 02 13:43:16.142276 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.142186 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.145569 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.145550 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.149495 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.149471 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7dbc8c0e-a0c5-4a45-82b5-b299ac0da213-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-x7snb\" (UID: \"7dbc8c0e-a0c5-4a45-82b5-b299ac0da213\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" Nov 02 13:43:16.152905 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.152887 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Nov 02 13:43:16.153138 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.153118 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Nov 02 13:43:16.166423 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.166398 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Nov 02 13:43:16.167838 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.167806 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-dh8qv"] Nov 02 13:43:16.184047 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.184001 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Nov 02 13:43:16.184178 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.184104 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Nov 02 13:43:16.187228 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.187208 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569dd4f648-mvjn9"] Nov 02 13:43:16.211443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.211416 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Nov 02 13:43:16.211627 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.211612 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Nov 02 13:43:16.211681 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.211646 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-l7z5r\"" Nov 02 13:43:16.211777 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.211761 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mtv77\"" Nov 02 13:43:16.211828 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.211806 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Nov 02 13:43:16.236360 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.236333 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68cbf76f9-s86hn"] Nov 02 13:43:16.239934 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.239915 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.250404 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250382 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e12b7938-3f78-4c8a-90fb-c7f4ad294764-tmp\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.250514 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250411 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-config\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.250514 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250427 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sxw8\" (UniqueName: \"kubernetes.io/projected/e12b7938-3f78-4c8a-90fb-c7f4ad294764-kube-api-access-8sxw8\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.250514 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250455 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-oauth-serving-cert\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.250715 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250664 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-serving-cert\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.250767 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250725 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7dbc8c0e-a0c5-4a45-82b5-b299ac0da213-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-x7snb\" (UID: \"7dbc8c0e-a0c5-4a45-82b5-b299ac0da213\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" Nov 02 13:43:16.250767 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250758 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5wwr\" (UniqueName: \"kubernetes.io/projected/0fe2a38d-9948-4387-98de-892cb608ea8e-kube-api-access-x5wwr\") pod \"downloads-6dd789c8b7-dh8qv\" (UID: \"0fe2a38d-9948-4387-98de-892cb608ea8e\") " pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.250861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250784 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-oauth-config\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.250916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250887 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-service-ca\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.250969 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.250921 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fe2a38d-9948-4387-98de-892cb608ea8e-tmp\") pod \"downloads-6dd789c8b7-dh8qv\" (UID: \"0fe2a38d-9948-4387-98de-892cb608ea8e\") " pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.253521 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.253502 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7dbc8c0e-a0c5-4a45-82b5-b299ac0da213-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-x7snb\" (UID: \"7dbc8c0e-a0c5-4a45-82b5-b299ac0da213\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" Nov 02 13:43:16.257367 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.257345 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cbf76f9-s86hn"] Nov 02 13:43:16.351608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351517 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5wwr\" (UniqueName: \"kubernetes.io/projected/0fe2a38d-9948-4387-98de-892cb608ea8e-kube-api-access-x5wwr\") pod \"downloads-6dd789c8b7-dh8qv\" (UID: \"0fe2a38d-9948-4387-98de-892cb608ea8e\") " pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.351608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351578 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-oauth-config\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.351608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351601 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4916b820-a289-4c96-bf86-d4d42a3a09ef-trusted-ca\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.351871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351625 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4916b820-a289-4c96-bf86-d4d42a3a09ef-installation-pull-secrets\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.351871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351653 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-service-ca\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.351871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351668 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fe2a38d-9948-4387-98de-892cb608ea8e-tmp\") pod \"downloads-6dd789c8b7-dh8qv\" (UID: \"0fe2a38d-9948-4387-98de-892cb608ea8e\") " pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.351871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351801 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4916b820-a289-4c96-bf86-d4d42a3a09ef-ca-trust-extracted\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.352078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351894 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-registry-tls\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.352078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351937 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e12b7938-3f78-4c8a-90fb-c7f4ad294764-tmp\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351957 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4916b820-a289-4c96-bf86-d4d42a3a09ef-image-registry-private-configuration\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.352078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.351983 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-config\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352041 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sxw8\" (UniqueName: \"kubernetes.io/projected/e12b7938-3f78-4c8a-90fb-c7f4ad294764-kube-api-access-8sxw8\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352326 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352121 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fe2a38d-9948-4387-98de-892cb608ea8e-tmp\") pod \"downloads-6dd789c8b7-dh8qv\" (UID: \"0fe2a38d-9948-4387-98de-892cb608ea8e\") " pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.352326 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352133 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-bound-sa-token\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.352326 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352214 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4916b820-a289-4c96-bf86-d4d42a3a09ef-registry-certificates\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.352326 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352295 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-oauth-serving-cert\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352566 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352332 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-serving-cert\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352566 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352359 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e12b7938-3f78-4c8a-90fb-c7f4ad294764-tmp\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352566 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352371 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6g8\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-kube-api-access-bf6g8\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.352566 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352502 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-service-ca\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352698 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352607 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-config\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.352941 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.352925 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-oauth-serving-cert\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.354296 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.354278 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-oauth-config\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.354699 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.354682 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-serving-cert\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.364950 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.364922 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5wwr\" (UniqueName: \"kubernetes.io/projected/0fe2a38d-9948-4387-98de-892cb608ea8e-kube-api-access-x5wwr\") pod \"downloads-6dd789c8b7-dh8qv\" (UID: \"0fe2a38d-9948-4387-98de-892cb608ea8e\") " pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.365143 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.365126 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sxw8\" (UniqueName: \"kubernetes.io/projected/e12b7938-3f78-4c8a-90fb-c7f4ad294764-kube-api-access-8sxw8\") pod \"console-569dd4f648-mvjn9\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.399645 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.399619 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" Nov 02 13:43:16.454855 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.454825 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6g8\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-kube-api-access-bf6g8\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.455007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.454890 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4916b820-a289-4c96-bf86-d4d42a3a09ef-trusted-ca\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.455007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.454919 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4916b820-a289-4c96-bf86-d4d42a3a09ef-installation-pull-secrets\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.455007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.454963 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4916b820-a289-4c96-bf86-d4d42a3a09ef-ca-trust-extracted\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.455185 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.455007 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-registry-tls\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.455185 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.455045 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4916b820-a289-4c96-bf86-d4d42a3a09ef-image-registry-private-configuration\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.455185 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.455077 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-bound-sa-token\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.455185 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.455105 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4916b820-a289-4c96-bf86-d4d42a3a09ef-registry-certificates\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.456044 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.456016 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4916b820-a289-4c96-bf86-d4d42a3a09ef-registry-certificates\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.456191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.456155 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4916b820-a289-4c96-bf86-d4d42a3a09ef-trusted-ca\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.456609 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.456587 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4916b820-a289-4c96-bf86-d4d42a3a09ef-ca-trust-extracted\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.456735 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.456719 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:16.458800 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.458751 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4916b820-a289-4c96-bf86-d4d42a3a09ef-image-registry-private-configuration\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.459108 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.459069 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-registry-tls\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.459907 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.459874 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4916b820-a289-4c96-bf86-d4d42a3a09ef-installation-pull-secrets\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.461383 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.461368 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:16.480461 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.480416 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6g8\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-kube-api-access-bf6g8\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.481425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.481397 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4916b820-a289-4c96-bf86-d4d42a3a09ef-bound-sa-token\") pod \"image-registry-68cbf76f9-s86hn\" (UID: \"4916b820-a289-4c96-bf86-d4d42a3a09ef\") " pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.552098 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.551776 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:16.681474 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.681450 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb"] Nov 02 13:43:16.684004 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:16.683974 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dbc8c0e_a0c5_4a45_82b5_b299ac0da213.slice/crio-0f8e4733beae4819548c63dd621434635879b10abb2de62c8dbd006c8d5787d3 WatchSource:0}: Error finding container 0f8e4733beae4819548c63dd621434635879b10abb2de62c8dbd006c8d5787d3: Status 404 returned error can't find the container with id 0f8e4733beae4819548c63dd621434635879b10abb2de62c8dbd006c8d5787d3 Nov 02 13:43:16.753874 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.753845 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569dd4f648-mvjn9"] Nov 02 13:43:16.757043 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:16.757013 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12b7938_3f78_4c8a_90fb_c7f4ad294764.slice/crio-0cf6620e2cd3756546a746a1e875dd426ea17b32903d299c83f76b4738a8b208 WatchSource:0}: Error finding container 0cf6620e2cd3756546a746a1e875dd426ea17b32903d299c83f76b4738a8b208: Status 404 returned error can't find the container with id 0cf6620e2cd3756546a746a1e875dd426ea17b32903d299c83f76b4738a8b208 Nov 02 13:43:16.773695 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.773670 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-dh8qv"] Nov 02 13:43:16.776810 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:16.776783 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe2a38d_9948_4387_98de_892cb608ea8e.slice/crio-a931415add4a1d68035096af895cb7ea0620bcab88b1781e68446161ed7a2169 WatchSource:0}: Error finding container a931415add4a1d68035096af895cb7ea0620bcab88b1781e68446161ed7a2169: Status 404 returned error can't find the container with id a931415add4a1d68035096af895cb7ea0620bcab88b1781e68446161ed7a2169 Nov 02 13:43:16.838295 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:16.838263 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68cbf76f9-s86hn"] Nov 02 13:43:16.841024 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:16.840994 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4916b820_a289_4c96_bf86_d4d42a3a09ef.slice/crio-246b3ce2a59dedab9ca1bd146fc7cd7d4646c5873b1c40257a7509b1e17f6aee WatchSource:0}: Error finding container 246b3ce2a59dedab9ca1bd146fc7cd7d4646c5873b1c40257a7509b1e17f6aee: Status 404 returned error can't find the container with id 246b3ce2a59dedab9ca1bd146fc7cd7d4646c5873b1c40257a7509b1e17f6aee Nov 02 13:43:17.185228 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.185191 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:17.247285 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.247254 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dntcg" Nov 02 13:43:17.319178 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.318186 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" event={"ID":"4916b820-a289-4c96-bf86-d4d42a3a09ef","Type":"ContainerStarted","Data":"e323045cef4eaba647db54025c9298fa5f8e7a871cc5fd253b3095ef24d26f66"} Nov 02 13:43:17.319178 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.318247 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" event={"ID":"4916b820-a289-4c96-bf86-d4d42a3a09ef","Type":"ContainerStarted","Data":"246b3ce2a59dedab9ca1bd146fc7cd7d4646c5873b1c40257a7509b1e17f6aee"} Nov 02 13:43:17.319178 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.319059 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:17.321249 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.321196 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" event={"ID":"7dbc8c0e-a0c5-4a45-82b5-b299ac0da213","Type":"ContainerStarted","Data":"0f8e4733beae4819548c63dd621434635879b10abb2de62c8dbd006c8d5787d3"} Nov 02 13:43:17.324425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.324399 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd4f648-mvjn9" event={"ID":"e12b7938-3f78-4c8a-90fb-c7f4ad294764","Type":"ContainerStarted","Data":"0cf6620e2cd3756546a746a1e875dd426ea17b32903d299c83f76b4738a8b208"} Nov 02 13:43:17.327916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.327872 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-dh8qv" event={"ID":"0fe2a38d-9948-4387-98de-892cb608ea8e","Type":"ContainerStarted","Data":"a931415add4a1d68035096af895cb7ea0620bcab88b1781e68446161ed7a2169"} Nov 02 13:43:17.351841 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:17.351082 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" podStartSLOduration=1.351063165 podStartE2EDuration="1.351063165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:17.347758409 +0000 UTC m=+15.340146718" watchObservedRunningTime="2026-11-02 13:43:17.351063165 +0000 UTC m=+15.343451450" Nov 02 13:43:18.335990 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:18.335429 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" event={"ID":"7dbc8c0e-a0c5-4a45-82b5-b299ac0da213","Type":"ContainerStarted","Data":"0eadda9da3c34ed9f966e70b81fc707dfeb17668a52b1cf5648e06d944f99348"} Nov 02 13:43:18.357069 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:18.357008 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" podStartSLOduration=1.059190116 podStartE2EDuration="2.356989678s" totalImagesPullingTime="1.297799562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:18.355968234 +0000 UTC m=+16.348356542" watchObservedRunningTime="2026-11-02 13:43:18.356989678 +0000 UTC m=+16.349377965" Nov 02 13:43:19.340629 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:19.340598 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" Nov 02 13:43:19.346633 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:19.346394 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-x7snb" Nov 02 13:43:20.347752 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:20.347697 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd4f648-mvjn9" event={"ID":"e12b7938-3f78-4c8a-90fb-c7f4ad294764","Type":"ContainerStarted","Data":"d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024"} Nov 02 13:43:20.369656 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:20.369611 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-569dd4f648-mvjn9" podStartSLOduration=1.259943231 podStartE2EDuration="4.36959721s" totalImagesPullingTime="3.109653979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:20.36897762 +0000 UTC m=+18.361365919" watchObservedRunningTime="2026-11-02 13:43:20.36959721 +0000 UTC m=+18.361985494" Nov 02 13:43:20.711482 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:20.711448 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:22.288915 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:22.288882 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jz2g5" Nov 02 13:43:24.493891 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.493858 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z2t8f"] Nov 02 13:43:24.500689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.500664 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.575909 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.575865 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Nov 02 13:43:24.576298 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.576237 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Nov 02 13:43:24.576298 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.576242 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gnlzz\"" Nov 02 13:43:24.591047 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.591025 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Nov 02 13:43:24.591158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.591136 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Nov 02 13:43:24.634471 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634437 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-sys\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.634661 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634485 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.634733 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634653 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-wtmp\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.634792 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634731 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-root\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.634792 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634758 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84e5717-df90-411f-84dd-d82ba6155595-metrics-client-ca\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.634792 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634776 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-tls\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.634898 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634882 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxbt7\" (UniqueName: \"kubernetes.io/projected/c84e5717-df90-411f-84dd-d82ba6155595-kube-api-access-hxbt7\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.634948 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.634925 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.635020 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.635003 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-textfile\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736462 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736431 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-sys\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736462 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736464 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736508 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-wtmp\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736585 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-sys\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736586 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-root\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736622 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-root\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736641 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84e5717-df90-411f-84dd-d82ba6155595-metrics-client-ca\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736666 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-tls\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.736728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736709 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxbt7\" (UniqueName: \"kubernetes.io/projected/c84e5717-df90-411f-84dd-d82ba6155595-kube-api-access-hxbt7\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.737054 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736733 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-wtmp\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.737054 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736747 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.737054 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.736798 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-textfile\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.737145 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.737100 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-textfile\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.737352 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.737330 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.737389 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.737342 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c84e5717-df90-411f-84dd-d82ba6155595-metrics-client-ca\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.739673 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.739649 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-tls\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.739956 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.739924 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c84e5717-df90-411f-84dd-d82ba6155595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.751175 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.751109 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxbt7\" (UniqueName: \"kubernetes.io/projected/c84e5717-df90-411f-84dd-d82ba6155595-kube-api-access-hxbt7\") pod \"node-exporter-z2t8f\" (UID: \"c84e5717-df90-411f-84dd-d82ba6155595\") " pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.828032 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:24.827998 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2t8f" Nov 02 13:43:24.866284 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:24.866251 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84e5717_df90_411f_84dd_d82ba6155595.slice/crio-9a43315d9f71ee29f4babbb1cf9361b37a175dc68435b220626a6cd072b9226c WatchSource:0}: Error finding container 9a43315d9f71ee29f4babbb1cf9361b37a175dc68435b220626a6cd072b9226c: Status 404 returned error can't find the container with id 9a43315d9f71ee29f4babbb1cf9361b37a175dc68435b220626a6cd072b9226c Nov 02 13:43:25.372235 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:25.372193 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2t8f" event={"ID":"c84e5717-df90-411f-84dd-d82ba6155595","Type":"ContainerStarted","Data":"9a43315d9f71ee29f4babbb1cf9361b37a175dc68435b220626a6cd072b9226c"} Nov 02 13:43:26.462046 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:26.462019 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:26.462453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:26.462077 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:26.467517 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:26.467493 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:27.190473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:27.190445 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:43:27.382951 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:27.382914 5081 generic.go:356] "Generic (PLEG): container finished" podID="c84e5717-df90-411f-84dd-d82ba6155595" containerID="288eba833d10d1531126be36f29235f40959576b89ab8255d3556c315afc0a05" exitCode=0 Nov 02 13:43:27.383145 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:27.383003 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2t8f" event={"ID":"c84e5717-df90-411f-84dd-d82ba6155595","Type":"ContainerDied","Data":"288eba833d10d1531126be36f29235f40959576b89ab8255d3556c315afc0a05"} Nov 02 13:43:27.388092 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:27.388077 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:43:28.390964 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:28.390919 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2t8f" event={"ID":"c84e5717-df90-411f-84dd-d82ba6155595","Type":"ContainerStarted","Data":"bc6b6bb6b2aa8edcb8e05191827f2dd46bc25bfb918d82a0de23acb038e6d2de"} Nov 02 13:43:28.391405 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:28.390992 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2t8f" event={"ID":"c84e5717-df90-411f-84dd-d82ba6155595","Type":"ContainerStarted","Data":"678b931e9e8ebc4f25e92e8a0309f9e1bb570db9d523c99a368feb860e9b9f95"} Nov 02 13:43:28.426078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:28.426015 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z2t8f" podStartSLOduration=2.772459504 podStartE2EDuration="4.426001144s" totalImagesPullingTime="1.558591906s" totalInitContainerRuntime="94.949734ms" isStatefulPod=true podCreationTimestamp="2026-11-02 13:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:28.424260966 +0000 UTC m=+26.416649251" watchObservedRunningTime="2026-11-02 13:43:28.426001144 +0000 UTC m=+26.418389424" Nov 02 13:43:29.750807 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:29.750774 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xkt2c" Nov 02 13:43:30.718377 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:30.718101 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:33.413894 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.413863 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6cb74bbf4f-h9lgb"] Nov 02 13:43:33.432438 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.432411 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.460008 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.459042 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb74bbf4f-h9lgb"] Nov 02 13:43:33.460182 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.460131 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Nov 02 13:43:33.520404 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520373 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-service-ca\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.520589 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520426 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-trusted-ca-bundle\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.520589 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520510 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-console-config\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.520708 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520616 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-oauth-serving-cert\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.520708 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520647 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-serving-cert\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.520708 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520692 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-oauth-config\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.520819 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520791 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97ce302-8755-4d21-a83c-5424046dec72-tmp\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.520864 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.520836 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb6fn\" (UniqueName: \"kubernetes.io/projected/e97ce302-8755-4d21-a83c-5424046dec72-kube-api-access-qb6fn\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.621720 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621696 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-serving-cert\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.621868 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621741 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-oauth-config\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.621868 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621759 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97ce302-8755-4d21-a83c-5424046dec72-tmp\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.621868 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621785 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb6fn\" (UniqueName: \"kubernetes.io/projected/e97ce302-8755-4d21-a83c-5424046dec72-kube-api-access-qb6fn\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.621868 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621801 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-service-ca\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.621868 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621826 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-trusted-ca-bundle\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.621868 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621844 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-console-config\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.622267 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.621982 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-oauth-serving-cert\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.622561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.622492 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97ce302-8755-4d21-a83c-5424046dec72-tmp\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.622770 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.622746 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-oauth-serving-cert\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.622851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.622803 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-console-config\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.622936 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.622913 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-trusted-ca-bundle\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.622993 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.622945 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-service-ca\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.624907 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.624885 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-serving-cert\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.625011 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.624992 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-oauth-config\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.637109 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.637089 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb6fn\" (UniqueName: \"kubernetes.io/projected/e97ce302-8755-4d21-a83c-5424046dec72-kube-api-access-qb6fn\") pod \"console-6cb74bbf4f-h9lgb\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:33.778460 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:33.778376 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:34.073392 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.073313 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6cb74bbf4f-h9lgb"] Nov 02 13:43:34.078131 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:43:34.078088 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode97ce302_8755_4d21_a83c_5424046dec72.slice/crio-9f8ff7224ec2a5e35f9ed242338f4249debb184c950fa3cc22800e0d114e5e82 WatchSource:0}: Error finding container 9f8ff7224ec2a5e35f9ed242338f4249debb184c950fa3cc22800e0d114e5e82: Status 404 returned error can't find the container with id 9f8ff7224ec2a5e35f9ed242338f4249debb184c950fa3cc22800e0d114e5e82 Nov 02 13:43:34.424300 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.424260 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-dh8qv" event={"ID":"0fe2a38d-9948-4387-98de-892cb608ea8e","Type":"ContainerStarted","Data":"7b87988814827f6fd660372a3183197e04fd3583b3f45f75a8ba3821919de922"} Nov 02 13:43:34.425313 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.424475 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:34.426627 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.426599 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb74bbf4f-h9lgb" event={"ID":"e97ce302-8755-4d21-a83c-5424046dec72","Type":"ContainerStarted","Data":"d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030"} Nov 02 13:43:34.426770 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.426648 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb74bbf4f-h9lgb" event={"ID":"e97ce302-8755-4d21-a83c-5424046dec72","Type":"ContainerStarted","Data":"9f8ff7224ec2a5e35f9ed242338f4249debb184c950fa3cc22800e0d114e5e82"} Nov 02 13:43:34.439436 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.439413 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-dh8qv" Nov 02 13:43:34.452820 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.452763 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-dh8qv" podStartSLOduration=1.6838831760000001 podStartE2EDuration="18.45274515s" totalImagesPullingTime="16.768861974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:34.4510619 +0000 UTC m=+32.443450215" watchObservedRunningTime="2026-11-02 13:43:34.45274515 +0000 UTC m=+32.445133436" Nov 02 13:43:34.525473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:34.525417 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6cb74bbf4f-h9lgb" podStartSLOduration=1.525398263 podStartE2EDuration="1.525398263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:43:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:43:34.525366171 +0000 UTC m=+32.517754477" watchObservedRunningTime="2026-11-02 13:43:34.525398263 +0000 UTC m=+32.517786547" Nov 02 13:43:38.567866 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:38.567821 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:43:39.345144 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:39.345115 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68cbf76f9-s86hn" Nov 02 13:43:39.417880 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:39.417846 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55d4868459-8zb5p"] Nov 02 13:43:41.111135 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.111011 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" podUID="425863c0-acb7-4822-89c6-2329077e182e" containerName="registry" containerID="cri-o://f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f" gracePeriod=30 Nov 02 13:43:41.430848 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.430817 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:41.465568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.464994 5081 generic.go:356] "Generic (PLEG): container finished" podID="425863c0-acb7-4822-89c6-2329077e182e" containerID="f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f" exitCode=0 Nov 02 13:43:41.465568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.465099 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" event={"ID":"425863c0-acb7-4822-89c6-2329077e182e","Type":"ContainerDied","Data":"f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f"} Nov 02 13:43:41.465568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.465149 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" event={"ID":"425863c0-acb7-4822-89c6-2329077e182e","Type":"ContainerDied","Data":"6b2ee97003de2280b10c988dd487f0d4bbab83b36d4ed856e4e0ba4047454c0d"} Nov 02 13:43:41.465568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.465184 5081 scope.go:122] "RemoveContainer" containerID="f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f" Nov 02 13:43:41.465568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.465350 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc775dc7d-7bvmj" Nov 02 13:43:41.477674 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.477501 5081 scope.go:122] "RemoveContainer" containerID="f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f" Nov 02 13:43:41.477976 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:43:41.477946 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f\": container with ID starting with f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f not found: ID does not exist" containerID="f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f" Nov 02 13:43:41.478094 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.477988 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f"} err="failed to get container status \"f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f\": rpc error: code = NotFound desc = could not find container \"f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f\": container with ID starting with f1876a00d7cdb315fae5c3eafddb18b477178e754a1be0861f1f868e697a7c8f not found: ID does not exist" Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503524 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503652 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503688 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503738 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503789 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503845 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503885 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.503916 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\") pod \"425863c0-acb7-4822-89c6-2329077e182e\" (UID: \"425863c0-acb7-4822-89c6-2329077e182e\") " Nov 02 13:43:41.504827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.504654 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:43:41.504971 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.504941 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:43:41.512614 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.512584 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:43:41.514888 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.514862 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:43:41.517851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.517820 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:43:41.518180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.518144 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:43:41.518875 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.518840 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:43:41.518970 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.518918 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c" pod "425863c0-acb7-4822-89c6-2329077e182e" (UID: "425863c0-acb7-4822-89c6-2329077e182e"). InnerVolumeSpecName "kube-api-access-f6f2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:43:41.604846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604807 5081 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-registry-certificates\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.604846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604849 5081 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-bound-sa-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.605122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604866 5081 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/425863c0-acb7-4822-89c6-2329077e182e-ca-trust-extracted\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.605122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604881 5081 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-registry-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.605122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604895 5081 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-image-registry-private-configuration\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.605122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604905 5081 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/425863c0-acb7-4822-89c6-2329077e182e-installation-pull-secrets\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.605122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604914 5081 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/425863c0-acb7-4822-89c6-2329077e182e-trusted-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.605122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.604923 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6f2c\" (UniqueName: \"kubernetes.io/projected/425863c0-acb7-4822-89c6-2329077e182e-kube-api-access-f6f2c\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:43:41.803168 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.803134 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dc775dc7d-7bvmj"] Nov 02 13:43:41.812880 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:41.812846 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dc775dc7d-7bvmj"] Nov 02 13:43:42.136469 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:42.136386 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="425863c0-acb7-4822-89c6-2329077e182e" path="/var/lib/kubelet/pods/425863c0-acb7-4822-89c6-2329077e182e/volumes" Nov 02 13:43:43.779052 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:43.779008 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:43.779514 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:43.779069 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:43.783696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:43.783674 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:44.482823 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:44.482799 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:43:44.549405 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:43:44.549375 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-569dd4f648-mvjn9"] Nov 02 13:44:04.442710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.442653 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" podUID="0b06c7cb-83c1-4b64-9651-d8be16cd4142" containerName="registry" containerID="cri-o://926122024e74905c7f4b29cb36085e3ce2838f7a4092bbc96b22a2941a1b6518" gracePeriod=30 Nov 02 13:44:04.564918 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.564891 5081 generic.go:356] "Generic (PLEG): container finished" podID="0b06c7cb-83c1-4b64-9651-d8be16cd4142" containerID="926122024e74905c7f4b29cb36085e3ce2838f7a4092bbc96b22a2941a1b6518" exitCode=0 Nov 02 13:44:04.565067 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.564964 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" event={"ID":"0b06c7cb-83c1-4b64-9651-d8be16cd4142","Type":"ContainerDied","Data":"926122024e74905c7f4b29cb36085e3ce2838f7a4092bbc96b22a2941a1b6518"} Nov 02 13:44:04.727662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.727632 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:44:04.812547 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812513 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.812713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812577 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.812713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812605 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.812820 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812706 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.812820 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812754 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.812820 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812790 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.812978 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812830 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.812978 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.812909 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\") pod \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\" (UID: \"0b06c7cb-83c1-4b64-9651-d8be16cd4142\") " Nov 02 13:44:04.813138 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.813113 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:04.813250 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.813230 5081 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-trusted-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:04.813316 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.813273 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:04.815090 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.815066 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:44:04.815485 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.815457 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:44:04.815707 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.815680 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:44:04.815814 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.815769 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:44:04.815873 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.815851 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "kube-api-access-wj4fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:44:04.819900 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.819877 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted" pod "0b06c7cb-83c1-4b64-9651-d8be16cd4142" (UID: "0b06c7cb-83c1-4b64-9651-d8be16cd4142"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:44:04.914517 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.914488 5081 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:04.914517 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.914514 5081 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-bound-sa-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:04.914736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.914524 5081 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0b06c7cb-83c1-4b64-9651-d8be16cd4142-registry-certificates\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:04.914736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.914556 5081 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0b06c7cb-83c1-4b64-9651-d8be16cd4142-ca-trust-extracted\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:04.914736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.914565 5081 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-installation-pull-secrets\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:04.914736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.914575 5081 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0b06c7cb-83c1-4b64-9651-d8be16cd4142-image-registry-private-configuration\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:04.914736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:04.914584 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj4fn\" (UniqueName: \"kubernetes.io/projected/0b06c7cb-83c1-4b64-9651-d8be16cd4142-kube-api-access-wj4fn\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:05.570662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:05.570632 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" Nov 02 13:44:05.571084 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:05.570648 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55d4868459-8zb5p" event={"ID":"0b06c7cb-83c1-4b64-9651-d8be16cd4142","Type":"ContainerDied","Data":"0a1628ae48ddf67f10e13e56416ce93604bfba59b15e102ef857123a7fa09255"} Nov 02 13:44:05.571084 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:05.570712 5081 scope.go:122] "RemoveContainer" containerID="926122024e74905c7f4b29cb36085e3ce2838f7a4092bbc96b22a2941a1b6518" Nov 02 13:44:05.594727 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:05.594704 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55d4868459-8zb5p"] Nov 02 13:44:05.597354 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:05.597335 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55d4868459-8zb5p"] Nov 02 13:44:06.134489 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:06.134459 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0b06c7cb-83c1-4b64-9651-d8be16cd4142" path="/var/lib/kubelet/pods/0b06c7cb-83c1-4b64-9651-d8be16cd4142/volumes" Nov 02 13:44:08.555031 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:44:08.554992 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:44:09.571090 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.571053 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-569dd4f648-mvjn9" podUID="e12b7938-3f78-4c8a-90fb-c7f4ad294764" containerName="console" containerID="cri-o://d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024" gracePeriod=15 Nov 02 13:44:09.847091 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.847063 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:44:09.962081 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962053 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-config\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-config\") pod \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " Nov 02 13:44:09.962289 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962088 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e12b7938-3f78-4c8a-90fb-c7f4ad294764-kube-api-access-8sxw8\" (UniqueName: \"kubernetes.io/projected/e12b7938-3f78-4c8a-90fb-c7f4ad294764-kube-api-access-8sxw8\") pod \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " Nov 02 13:44:09.962289 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962123 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e12b7938-3f78-4c8a-90fb-c7f4ad294764-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e12b7938-3f78-4c8a-90fb-c7f4ad294764-tmp\") pod \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " Nov 02 13:44:09.962289 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962141 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-oauth-serving-cert\") pod \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " Nov 02 13:44:09.962289 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962159 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-oauth-config\") pod \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " Nov 02 13:44:09.962289 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962181 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-serving-cert\") pod \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " Nov 02 13:44:09.962289 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962260 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-service-ca\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-service-ca\") pod \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\" (UID: \"e12b7938-3f78-4c8a-90fb-c7f4ad294764\") " Nov 02 13:44:09.962620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962496 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e12b7938-3f78-4c8a-90fb-c7f4ad294764-tmp" pod "e12b7938-3f78-4c8a-90fb-c7f4ad294764" (UID: "e12b7938-3f78-4c8a-90fb-c7f4ad294764"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:44:09.962749 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962710 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-config" pod "e12b7938-3f78-4c8a-90fb-c7f4ad294764" (UID: "e12b7938-3f78-4c8a-90fb-c7f4ad294764"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:09.962881 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962745 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-oauth-serving-cert" pod "e12b7938-3f78-4c8a-90fb-c7f4ad294764" (UID: "e12b7938-3f78-4c8a-90fb-c7f4ad294764"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:09.962881 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.962788 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-service-ca" pod "e12b7938-3f78-4c8a-90fb-c7f4ad294764" (UID: "e12b7938-3f78-4c8a-90fb-c7f4ad294764"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:09.964697 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.964673 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-serving-cert" pod "e12b7938-3f78-4c8a-90fb-c7f4ad294764" (UID: "e12b7938-3f78-4c8a-90fb-c7f4ad294764"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:44:09.964807 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.964696 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-oauth-config" pod "e12b7938-3f78-4c8a-90fb-c7f4ad294764" (UID: "e12b7938-3f78-4c8a-90fb-c7f4ad294764"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:44:09.964861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:09.964797 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e12b7938-3f78-4c8a-90fb-c7f4ad294764-kube-api-access-8sxw8" pod "e12b7938-3f78-4c8a-90fb-c7f4ad294764" (UID: "e12b7938-3f78-4c8a-90fb-c7f4ad294764"). InnerVolumeSpecName "kube-api-access-8sxw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:44:10.063809 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.063772 5081 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-config\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:10.063809 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.063803 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sxw8\" (UniqueName: \"kubernetes.io/projected/e12b7938-3f78-4c8a-90fb-c7f4ad294764-kube-api-access-8sxw8\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:10.064007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.063819 5081 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e12b7938-3f78-4c8a-90fb-c7f4ad294764-tmp\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:10.064007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.063833 5081 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-oauth-serving-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:10.064007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.063845 5081 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-oauth-config\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:10.064007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.063858 5081 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e12b7938-3f78-4c8a-90fb-c7f4ad294764-console-serving-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:10.064007 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.063870 5081 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e12b7938-3f78-4c8a-90fb-c7f4ad294764-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:10.592660 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.592631 5081 generic.go:356] "Generic (PLEG): container finished" podID="e12b7938-3f78-4c8a-90fb-c7f4ad294764" containerID="d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024" exitCode=0 Nov 02 13:44:10.593140 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.592675 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569dd4f648-mvjn9" Nov 02 13:44:10.593140 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.592685 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd4f648-mvjn9" event={"ID":"e12b7938-3f78-4c8a-90fb-c7f4ad294764","Type":"ContainerDied","Data":"d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024"} Nov 02 13:44:10.593140 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.592724 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569dd4f648-mvjn9" event={"ID":"e12b7938-3f78-4c8a-90fb-c7f4ad294764","Type":"ContainerDied","Data":"0cf6620e2cd3756546a746a1e875dd426ea17b32903d299c83f76b4738a8b208"} Nov 02 13:44:10.593140 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.592744 5081 scope.go:122] "RemoveContainer" containerID="d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024" Nov 02 13:44:10.601170 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.601154 5081 scope.go:122] "RemoveContainer" containerID="d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024" Nov 02 13:44:10.601460 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:44:10.601441 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024\": container with ID starting with d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024 not found: ID does not exist" containerID="d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024" Nov 02 13:44:10.601519 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.601469 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024"} err="failed to get container status \"d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024\": rpc error: code = NotFound desc = could not find container \"d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024\": container with ID starting with d3f6415471b1d90fdb5c4e1cd1e1f2ef396f3a17c2b317b59795a74e33c53024 not found: ID does not exist" Nov 02 13:44:10.612868 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.612844 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-569dd4f648-mvjn9"] Nov 02 13:44:10.615452 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:10.615432 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-569dd4f648-mvjn9"] Nov 02 13:44:12.135820 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:12.135789 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e12b7938-3f78-4c8a-90fb-c7f4ad294764" path="/var/lib/kubelet/pods/e12b7938-3f78-4c8a-90fb-c7f4ad294764/volumes" Nov 02 13:44:17.624372 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:17.624338 5081 generic.go:356] "Generic (PLEG): container finished" podID="020f9532-0954-430c-b455-024cc6e03be3" containerID="66d98b1f2eb7fa8aee106713c5d4af2ca7e8e9ab98ce18d1de78b03299c3807d" exitCode=0 Nov 02 13:44:17.624801 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:17.624413 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-js5gg" event={"ID":"020f9532-0954-430c-b455-024cc6e03be3","Type":"ContainerDied","Data":"66d98b1f2eb7fa8aee106713c5d4af2ca7e8e9ab98ce18d1de78b03299c3807d"} Nov 02 13:44:17.624801 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:17.624720 5081 scope.go:122] "RemoveContainer" containerID="66d98b1f2eb7fa8aee106713c5d4af2ca7e8e9ab98ce18d1de78b03299c3807d" Nov 02 13:44:18.278902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.278238 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-lc2vm-gwwjm"] Nov 02 13:44:18.278902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.278530 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" podUID="2abda0cb-8e51-4003-942e-27eb6bf88e92" containerName="insights-gathering" containerID="cri-o://6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae" gracePeriod=30 Nov 02 13:44:18.359996 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.359963 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-k4db5-8k5kd"] Nov 02 13:44:18.360298 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360285 5081 cpu_manager.go:414] "containerMap: removing container" podUID="425863c0-acb7-4822-89c6-2329077e182e" containerName="registry" Nov 02 13:44:18.360348 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360299 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="425863c0-acb7-4822-89c6-2329077e182e" containerName="registry" Nov 02 13:44:18.360348 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360313 5081 cpu_manager.go:414] "containerMap: removing container" podUID="e12b7938-3f78-4c8a-90fb-c7f4ad294764" containerName="console" Nov 02 13:44:18.360348 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360317 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e12b7938-3f78-4c8a-90fb-c7f4ad294764" containerName="console" Nov 02 13:44:18.360348 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360326 5081 cpu_manager.go:414] "containerMap: removing container" podUID="0b06c7cb-83c1-4b64-9651-d8be16cd4142" containerName="registry" Nov 02 13:44:18.360348 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360331 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0b06c7cb-83c1-4b64-9651-d8be16cd4142" containerName="registry" Nov 02 13:44:18.360487 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360385 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="425863c0-acb7-4822-89c6-2329077e182e" containerName="registry" Nov 02 13:44:18.360487 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360393 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="e12b7938-3f78-4c8a-90fb-c7f4ad294764" containerName="console" Nov 02 13:44:18.360487 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.360399 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="0b06c7cb-83c1-4b64-9651-d8be16cd4142" containerName="registry" Nov 02 13:44:18.381894 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.381860 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-k4db5-8k5kd"] Nov 02 13:44:18.382052 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.381958 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.423515 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.423478 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-trusted-ca-bundle\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.423670 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.423547 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-service-ca-bundle\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.423715 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.423679 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02d12b48-46f0-46df-9324-2efdbced83d7-archives-path\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.423759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.423731 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hddrd\" (UniqueName: \"kubernetes.io/projected/02d12b48-46f0-46df-9324-2efdbced83d7-kube-api-access-hddrd\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.525233 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.525198 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hddrd\" (UniqueName: \"kubernetes.io/projected/02d12b48-46f0-46df-9324-2efdbced83d7-kube-api-access-hddrd\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.525424 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.525251 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-trusted-ca-bundle\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.525424 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.525294 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-service-ca-bundle\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.525424 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.525316 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02d12b48-46f0-46df-9324-2efdbced83d7-archives-path\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.525665 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.525648 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02d12b48-46f0-46df-9324-2efdbced83d7-archives-path\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.526066 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.526040 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-service-ca-bundle\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.526401 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.526381 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-trusted-ca-bundle\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.538565 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.538517 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hddrd\" (UniqueName: \"kubernetes.io/projected/02d12b48-46f0-46df-9324-2efdbced83d7-kube-api-access-hddrd\") pod \"periodic-gathering-k4db5-8k5kd\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.591056 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.591031 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:44:18.626237 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.626207 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\") pod \"2abda0cb-8e51-4003-942e-27eb6bf88e92\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " Nov 02 13:44:18.626710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.626256 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\") pod \"2abda0cb-8e51-4003-942e-27eb6bf88e92\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " Nov 02 13:44:18.626710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.626295 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\" (UniqueName: \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\") pod \"2abda0cb-8e51-4003-942e-27eb6bf88e92\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " Nov 02 13:44:18.626710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.626351 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\") pod \"2abda0cb-8e51-4003-942e-27eb6bf88e92\" (UID: \"2abda0cb-8e51-4003-942e-27eb6bf88e92\") " Nov 02 13:44:18.626710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.626628 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle" pod "2abda0cb-8e51-4003-942e-27eb6bf88e92" (UID: "2abda0cb-8e51-4003-942e-27eb6bf88e92"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:18.626710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.626636 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle" pod "2abda0cb-8e51-4003-942e-27eb6bf88e92" (UID: "2abda0cb-8e51-4003-942e-27eb6bf88e92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:18.626936 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.626852 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path" pod "2abda0cb-8e51-4003-942e-27eb6bf88e92" (UID: "2abda0cb-8e51-4003-942e-27eb6bf88e92"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:44:18.629123 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.629096 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs" pod "2abda0cb-8e51-4003-942e-27eb6bf88e92" (UID: "2abda0cb-8e51-4003-942e-27eb6bf88e92"). InnerVolumeSpecName "kube-api-access-6mprs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:44:18.630447 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.630420 5081 generic.go:356] "Generic (PLEG): container finished" podID="2abda0cb-8e51-4003-942e-27eb6bf88e92" containerID="6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae" exitCode=2 Nov 02 13:44:18.630548 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.630464 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" Nov 02 13:44:18.630619 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.630507 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" event={"ID":"2abda0cb-8e51-4003-942e-27eb6bf88e92","Type":"ContainerDied","Data":"6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae"} Nov 02 13:44:18.630619 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.630605 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lc2vm-gwwjm" event={"ID":"2abda0cb-8e51-4003-942e-27eb6bf88e92","Type":"ContainerDied","Data":"ff5aceee486a334afec522b6049b70879fc19601d5c7aec6b57e0856dd668d7d"} Nov 02 13:44:18.630723 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.630637 5081 scope.go:122] "RemoveContainer" containerID="6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae" Nov 02 13:44:18.632943 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.632920 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-js5gg" event={"ID":"020f9532-0954-430c-b455-024cc6e03be3","Type":"ContainerStarted","Data":"11f3917b6bc2661e01917766fc150d6aeef774eb2cd78ff31d935c78014e6d50"} Nov 02 13:44:18.644180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.644146 5081 scope.go:122] "RemoveContainer" containerID="6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae" Nov 02 13:44:18.644605 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:44:18.644583 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae\": container with ID starting with 6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae not found: ID does not exist" containerID="6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae" Nov 02 13:44:18.644678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.644617 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae"} err="failed to get container status \"6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae\": rpc error: code = NotFound desc = could not find container \"6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae\": container with ID starting with 6c19f4a5b8511201e0db556bdee88ec67d0de5921bec76b6a088b1adb9e78dae not found: ID does not exist" Nov 02 13:44:18.673413 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.673381 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-lc2vm-gwwjm"] Nov 02 13:44:18.680417 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.680391 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-lc2vm-gwwjm"] Nov 02 13:44:18.724480 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.724455 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:44:18.727933 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.727907 5081 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/2abda0cb-8e51-4003-942e-27eb6bf88e92-archives-path\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:18.727933 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.727934 5081 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-service-ca-bundle\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:18.728127 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.728034 5081 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abda0cb-8e51-4003-942e-27eb6bf88e92-trusted-ca-bundle\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:18.728197 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:18.728168 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mprs\" (UniqueName: \"kubernetes.io/projected/2abda0cb-8e51-4003-942e-27eb6bf88e92-kube-api-access-6mprs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:19.024516 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:19.024434 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-k4db5-8k5kd"] Nov 02 13:44:19.027197 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:44:19.027166 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d12b48_46f0_46df_9324_2efdbced83d7.slice/crio-998d13b6e1db613bc16e9e52d5fd9f95a303a6a270d7ab7aed09478fd08a77a9 WatchSource:0}: Error finding container 998d13b6e1db613bc16e9e52d5fd9f95a303a6a270d7ab7aed09478fd08a77a9: Status 404 returned error can't find the container with id 998d13b6e1db613bc16e9e52d5fd9f95a303a6a270d7ab7aed09478fd08a77a9 Nov 02 13:44:19.639359 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:19.639318 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" event={"ID":"02d12b48-46f0-46df-9324-2efdbced83d7","Type":"ContainerStarted","Data":"6b1e6e4611bbe8db09d14528d6f08ce546fc8a758d1327783e3878635e4edd97"} Nov 02 13:44:19.639762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:19.639374 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" event={"ID":"02d12b48-46f0-46df-9324-2efdbced83d7","Type":"ContainerStarted","Data":"998d13b6e1db613bc16e9e52d5fd9f95a303a6a270d7ab7aed09478fd08a77a9"} Nov 02 13:44:19.659087 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:19.659034 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" podStartSLOduration=1.659020726 podStartE2EDuration="1.659020726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:44:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:44:19.658463968 +0000 UTC m=+77.650852250" watchObservedRunningTime="2026-11-02 13:44:19.659020726 +0000 UTC m=+77.651409010" Nov 02 13:44:20.135139 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:20.135106 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2abda0cb-8e51-4003-942e-27eb6bf88e92" path="/var/lib/kubelet/pods/2abda0cb-8e51-4003-942e-27eb6bf88e92/volumes" Nov 02 13:44:22.653896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:22.653859 5081 generic.go:356] "Generic (PLEG): container finished" podID="708e90f2-a35b-4028-b1e6-8e364d12b86b" containerID="f15399ffcc531a230bcb6c0341fd77b85be83992cad03060a42d2934338079a6" exitCode=0 Nov 02 13:44:22.654325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:22.653932 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" event={"ID":"708e90f2-a35b-4028-b1e6-8e364d12b86b","Type":"ContainerDied","Data":"f15399ffcc531a230bcb6c0341fd77b85be83992cad03060a42d2934338079a6"} Nov 02 13:44:22.654325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:22.654274 5081 scope.go:122] "RemoveContainer" containerID="f15399ffcc531a230bcb6c0341fd77b85be83992cad03060a42d2934338079a6" Nov 02 13:44:23.660100 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:23.660066 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-k2xv8" event={"ID":"708e90f2-a35b-4028-b1e6-8e364d12b86b","Type":"ContainerStarted","Data":"a594834ad0c95ddd0de31cff26d47d873db89751c9b5043bed10b7a8fde3c91f"} Nov 02 13:44:28.821097 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:28.821062 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb74bbf4f-h9lgb"] Nov 02 13:44:38.566347 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:44:38.566310 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:44:53.841752 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:53.841711 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6cb74bbf4f-h9lgb" podUID="e97ce302-8755-4d21-a83c-5424046dec72" containerName="console" containerID="cri-o://d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030" gracePeriod=15 Nov 02 13:44:54.083863 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.083834 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:44:54.245632 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245603 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-service-ca\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-service-ca\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.245842 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245652 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e97ce302-8755-4d21-a83c-5424046dec72-tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97ce302-8755-4d21-a83c-5424046dec72-tmp\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.245842 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245673 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e97ce302-8755-4d21-a83c-5424046dec72-kube-api-access-qb6fn\" (UniqueName: \"kubernetes.io/projected/e97ce302-8755-4d21-a83c-5424046dec72-kube-api-access-qb6fn\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.245842 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245715 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-oauth-config\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.245842 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245733 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-serving-cert\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.245842 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245776 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-trusted-ca-bundle\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.245842 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245794 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-console-config\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-console-config\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.245842 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245834 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-oauth-serving-cert\") pod \"e97ce302-8755-4d21-a83c-5424046dec72\" (UID: \"e97ce302-8755-4d21-a83c-5424046dec72\") " Nov 02 13:44:54.246203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.245944 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e97ce302-8755-4d21-a83c-5424046dec72-tmp" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:44:54.246203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.246112 5081 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e97ce302-8755-4d21-a83c-5424046dec72-tmp\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.246203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.246041 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-service-ca" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:54.246345 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.246249 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-trusted-ca-bundle" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:54.246345 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.246273 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-console-config" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:54.246494 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.246462 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-oauth-serving-cert" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:44:54.248148 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.248125 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-serving-cert" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:44:54.248254 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.248156 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-oauth-config" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:44:54.248254 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.248205 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e97ce302-8755-4d21-a83c-5424046dec72-kube-api-access-qb6fn" pod "e97ce302-8755-4d21-a83c-5424046dec72" (UID: "e97ce302-8755-4d21-a83c-5424046dec72"). InnerVolumeSpecName "kube-api-access-qb6fn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:44:54.347287 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.347257 5081 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-trusted-ca-bundle\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.347287 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.347285 5081 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-console-config\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.347481 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.347295 5081 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-oauth-serving-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.347481 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.347304 5081 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e97ce302-8755-4d21-a83c-5424046dec72-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.347481 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.347312 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb6fn\" (UniqueName: \"kubernetes.io/projected/e97ce302-8755-4d21-a83c-5424046dec72-kube-api-access-qb6fn\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.347481 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.347321 5081 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-oauth-config\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.347481 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.347330 5081 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e97ce302-8755-4d21-a83c-5424046dec72-console-serving-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:44:54.789845 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.789804 5081 generic.go:356] "Generic (PLEG): container finished" podID="e97ce302-8755-4d21-a83c-5424046dec72" containerID="d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030" exitCode=0 Nov 02 13:44:54.790018 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.789853 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb74bbf4f-h9lgb" event={"ID":"e97ce302-8755-4d21-a83c-5424046dec72","Type":"ContainerDied","Data":"d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030"} Nov 02 13:44:54.790018 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.789872 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6cb74bbf4f-h9lgb" Nov 02 13:44:54.790018 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.789929 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6cb74bbf4f-h9lgb" event={"ID":"e97ce302-8755-4d21-a83c-5424046dec72","Type":"ContainerDied","Data":"9f8ff7224ec2a5e35f9ed242338f4249debb184c950fa3cc22800e0d114e5e82"} Nov 02 13:44:54.790018 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.789955 5081 scope.go:122] "RemoveContainer" containerID="d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030" Nov 02 13:44:54.798827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.798807 5081 scope.go:122] "RemoveContainer" containerID="d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030" Nov 02 13:44:54.799093 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:44:54.799074 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030\": container with ID starting with d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030 not found: ID does not exist" containerID="d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030" Nov 02 13:44:54.799141 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.799101 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030"} err="failed to get container status \"d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030\": rpc error: code = NotFound desc = could not find container \"d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030\": container with ID starting with d14650bbcebb43e2aad4f108db6de61c43390245bb8eecac76219b5c27ffd030 not found: ID does not exist" Nov 02 13:44:54.812164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.812140 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6cb74bbf4f-h9lgb"] Nov 02 13:44:54.817099 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:54.817072 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6cb74bbf4f-h9lgb"] Nov 02 13:44:56.135413 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:44:56.135381 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e97ce302-8755-4d21-a83c-5424046dec72" path="/var/lib/kubelet/pods/e97ce302-8755-4d21-a83c-5424046dec72/volumes" Nov 02 13:45:08.554834 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:45:08.554799 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:45:38.555353 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:45:38.555314 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:45:42.987470 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:42.987437 5081 generic.go:356] "Generic (PLEG): container finished" podID="02d12b48-46f0-46df-9324-2efdbced83d7" containerID="6b1e6e4611bbe8db09d14528d6f08ce546fc8a758d1327783e3878635e4edd97" exitCode=0 Nov 02 13:45:42.987873 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:42.987506 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" event={"ID":"02d12b48-46f0-46df-9324-2efdbced83d7","Type":"ContainerDied","Data":"6b1e6e4611bbe8db09d14528d6f08ce546fc8a758d1327783e3878635e4edd97"} Nov 02 13:45:44.125719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.125692 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:45:44.174857 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.174827 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-service-ca-bundle\") pod \"02d12b48-46f0-46df-9324-2efdbced83d7\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " Nov 02 13:45:44.175023 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.174882 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/02d12b48-46f0-46df-9324-2efdbced83d7-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02d12b48-46f0-46df-9324-2efdbced83d7-archives-path\") pod \"02d12b48-46f0-46df-9324-2efdbced83d7\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " Nov 02 13:45:44.175023 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.174912 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-trusted-ca-bundle\") pod \"02d12b48-46f0-46df-9324-2efdbced83d7\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " Nov 02 13:45:44.175023 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.174937 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02d12b48-46f0-46df-9324-2efdbced83d7-kube-api-access-hddrd\" (UniqueName: \"kubernetes.io/projected/02d12b48-46f0-46df-9324-2efdbced83d7-kube-api-access-hddrd\") pod \"02d12b48-46f0-46df-9324-2efdbced83d7\" (UID: \"02d12b48-46f0-46df-9324-2efdbced83d7\") " Nov 02 13:45:44.175251 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.175227 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02d12b48-46f0-46df-9324-2efdbced83d7-archives-path" pod "02d12b48-46f0-46df-9324-2efdbced83d7" (UID: "02d12b48-46f0-46df-9324-2efdbced83d7"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:45:44.175316 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.175287 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-service-ca-bundle" pod "02d12b48-46f0-46df-9324-2efdbced83d7" (UID: "02d12b48-46f0-46df-9324-2efdbced83d7"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:45:44.175368 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.175327 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-trusted-ca-bundle" pod "02d12b48-46f0-46df-9324-2efdbced83d7" (UID: "02d12b48-46f0-46df-9324-2efdbced83d7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:45:44.177218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.177197 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d12b48-46f0-46df-9324-2efdbced83d7-kube-api-access-hddrd" pod "02d12b48-46f0-46df-9324-2efdbced83d7" (UID: "02d12b48-46f0-46df-9324-2efdbced83d7"). InnerVolumeSpecName "kube-api-access-hddrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:45:44.275847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.275774 5081 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/02d12b48-46f0-46df-9324-2efdbced83d7-archives-path\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:45:44.275847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.275800 5081 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-trusted-ca-bundle\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:45:44.275847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.275810 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hddrd\" (UniqueName: \"kubernetes.io/projected/02d12b48-46f0-46df-9324-2efdbced83d7-kube-api-access-hddrd\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:45:44.275847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.275819 5081 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02d12b48-46f0-46df-9324-2efdbced83d7-service-ca-bundle\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:45:44.997373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.997345 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" Nov 02 13:45:44.997373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.997352 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-k4db5-8k5kd" event={"ID":"02d12b48-46f0-46df-9324-2efdbced83d7","Type":"ContainerDied","Data":"998d13b6e1db613bc16e9e52d5fd9f95a303a6a270d7ab7aed09478fd08a77a9"} Nov 02 13:45:44.997625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:45:44.997399 5081 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="998d13b6e1db613bc16e9e52d5fd9f95a303a6a270d7ab7aed09478fd08a77a9" Nov 02 13:46:08.554309 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:46:08.554265 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:46:38.555356 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:46:38.555310 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:47:08.554387 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:47:08.554301 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:47:38.554808 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:47:38.554769 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:48:01.827820 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.827789 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49"] Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828135 5081 cpu_manager.go:414] "containerMap: removing container" podUID="02d12b48-46f0-46df-9324-2efdbced83d7" containerName="insights-gathering" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828146 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02d12b48-46f0-46df-9324-2efdbced83d7" containerName="insights-gathering" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828174 5081 cpu_manager.go:414] "containerMap: removing container" podUID="e97ce302-8755-4d21-a83c-5424046dec72" containerName="console" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828179 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e97ce302-8755-4d21-a83c-5424046dec72" containerName="console" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828186 5081 cpu_manager.go:414] "containerMap: removing container" podUID="2abda0cb-8e51-4003-942e-27eb6bf88e92" containerName="insights-gathering" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828190 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2abda0cb-8e51-4003-942e-27eb6bf88e92" containerName="insights-gathering" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828257 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="02d12b48-46f0-46df-9324-2efdbced83d7" containerName="insights-gathering" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828268 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="e97ce302-8755-4d21-a83c-5424046dec72" containerName="console" Nov 02 13:48:01.828271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.828274 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="2abda0cb-8e51-4003-942e-27eb6bf88e92" containerName="insights-gathering" Nov 02 13:48:01.831259 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.831239 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.837577 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.837530 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Nov 02 13:48:01.837760 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.837738 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ql6jd\"" Nov 02 13:48:01.851390 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.851359 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49"] Nov 02 13:48:01.944070 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944031 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944273 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944088 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944273 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944110 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944273 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944203 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10357ae6-63df-4967-8cc0-537b1e787d13-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944402 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944312 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944402 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944368 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10357ae6-63df-4967-8cc0-537b1e787d13-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944505 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944397 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmzbb\" (UniqueName: \"kubernetes.io/projected/10357ae6-63df-4967-8cc0-537b1e787d13-kube-api-access-dmzbb\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944505 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944429 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.944622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.944544 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10357ae6-63df-4967-8cc0-537b1e787d13-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:01.963884 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.963853 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm"] Nov 02 13:48:01.967145 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.967129 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:01.975221 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.975191 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-xsnpm\"" Nov 02 13:48:01.981487 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:01.981461 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm"] Nov 02 13:48:02.045344 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045309 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10357ae6-63df-4967-8cc0-537b1e787d13-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045523 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045355 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045523 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045412 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045523 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045438 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045584 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10357ae6-63df-4967-8cc0-537b1e787d13-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045618 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045652 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10357ae6-63df-4967-8cc0-537b1e787d13-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045678 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmzbb\" (UniqueName: \"kubernetes.io/projected/10357ae6-63df-4967-8cc0-537b1e787d13-kube-api-access-dmzbb\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045721 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045936 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045876 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.045993 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045927 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.046048 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.045991 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.046114 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.046099 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.046482 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.046458 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10357ae6-63df-4967-8cc0-537b1e787d13-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.048251 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.048234 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10357ae6-63df-4967-8cc0-537b1e787d13-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.048345 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.048326 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10357ae6-63df-4967-8cc0-537b1e787d13-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.058434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.058409 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10357ae6-63df-4967-8cc0-537b1e787d13-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.058620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.058597 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmzbb\" (UniqueName: \"kubernetes.io/projected/10357ae6-63df-4967-8cc0-537b1e787d13-kube-api-access-dmzbb\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-dlq49\" (UID: \"10357ae6-63df-4967-8cc0-537b1e787d13\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.146463 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146374 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktzzc\" (UniqueName: \"kubernetes.io/projected/9b954ca7-cf83-4f27-8e11-4195ef387b3b-kube-api-access-ktzzc\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146463 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146417 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146675 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146489 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146675 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146523 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146675 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146619 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146675 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146644 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146826 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146681 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146826 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146748 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.146826 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.146785 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.149709 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.149687 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ql6jd\"" Nov 02 13:48:02.156464 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.156442 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:02.157069 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.157048 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:48:02.158438 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.158418 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:48:02.247941 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.247909 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248115 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.247947 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248115 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.247983 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248115 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248013 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktzzc\" (UniqueName: \"kubernetes.io/projected/9b954ca7-cf83-4f27-8e11-4195ef387b3b-kube-api-access-ktzzc\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248115 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248034 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248168 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248238 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248279 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248314 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248390 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248709 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248684 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.248709 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.248699 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.249096 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.249070 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.250636 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.250611 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.250846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.250830 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.251607 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.251588 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b954ca7-cf83-4f27-8e11-4195ef387b3b-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.261186 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.261161 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b954ca7-cf83-4f27-8e11-4195ef387b3b-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.261428 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.261405 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktzzc\" (UniqueName: \"kubernetes.io/projected/9b954ca7-cf83-4f27-8e11-4195ef387b3b-kube-api-access-ktzzc\") pod \"openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm\" (UID: \"9b954ca7-cf83-4f27-8e11-4195ef387b3b\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.286213 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.286191 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-xsnpm\"" Nov 02 13:48:02.294303 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.294284 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:02.443299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.443218 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49"] Nov 02 13:48:02.445945 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:48:02.445916 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10357ae6_63df_4967_8cc0_537b1e787d13.slice/crio-2bbdb6bcb72e8ea7627e989a28094900cfe52ed2091c6246cf39297cc970fa6e WatchSource:0}: Error finding container 2bbdb6bcb72e8ea7627e989a28094900cfe52ed2091c6246cf39297cc970fa6e: Status 404 returned error can't find the container with id 2bbdb6bcb72e8ea7627e989a28094900cfe52ed2091c6246cf39297cc970fa6e Nov 02 13:48:02.533553 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.533505 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" event={"ID":"10357ae6-63df-4967-8cc0-537b1e787d13","Type":"ContainerStarted","Data":"2bbdb6bcb72e8ea7627e989a28094900cfe52ed2091c6246cf39297cc970fa6e"} Nov 02 13:48:02.579659 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:02.579599 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm"] Nov 02 13:48:02.582198 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:48:02.582171 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b954ca7_cf83_4f27_8e11_4195ef387b3b.slice/crio-e880503a977e4a6b3642c917ee7540516cf1562df02e68c0a6802cfa1abc74ee WatchSource:0}: Error finding container e880503a977e4a6b3642c917ee7540516cf1562df02e68c0a6802cfa1abc74ee: Status 404 returned error can't find the container with id e880503a977e4a6b3642c917ee7540516cf1562df02e68c0a6802cfa1abc74ee Nov 02 13:48:03.543880 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:03.543846 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" event={"ID":"9b954ca7-cf83-4f27-8e11-4195ef387b3b","Type":"ContainerStarted","Data":"e880503a977e4a6b3642c917ee7540516cf1562df02e68c0a6802cfa1abc74ee"} Nov 02 13:48:05.804189 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:05.804151 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:48:05.804599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:05.804241 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:48:05.804599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:05.804286 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:48:05.813818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:05.813781 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:48:05.814051 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:05.813852 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:48:05.814051 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:05.813892 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:48:06.561817 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:06.561779 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" event={"ID":"10357ae6-63df-4967-8cc0-537b1e787d13","Type":"ContainerStarted","Data":"89ee1123a4db08c41891ddc0d24e237c7f25d230cbe56a0ce50eed7312fb90eb"} Nov 02 13:48:06.563313 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:06.563287 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" event={"ID":"9b954ca7-cf83-4f27-8e11-4195ef387b3b","Type":"ContainerStarted","Data":"fadf153ad4d8cc48eb61f8a5a5a258421eb638ee9a4de009b8d6a87afb2d737c"} Nov 02 13:48:06.587967 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:06.587919 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" podStartSLOduration=2.222452604 podStartE2EDuration="5.587905459s" totalImagesPullingTime="3.365452855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:48:06.585868854 +0000 UTC m=+304.578257160" watchObservedRunningTime="2026-11-02 13:48:06.587905459 +0000 UTC m=+304.580293820" Nov 02 13:48:06.609322 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:06.609275 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" podStartSLOduration=2.389936181 podStartE2EDuration="5.609256301s" totalImagesPullingTime="3.21932012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:48:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:48:06.608584726 +0000 UTC m=+304.600973033" watchObservedRunningTime="2026-11-02 13:48:06.609256301 +0000 UTC m=+304.601644584" Nov 02 13:48:07.156995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.156958 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:07.161567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.161529 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:07.294701 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.294664 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:07.299551 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.299508 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:07.568397 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.568317 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:07.568651 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.568628 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:07.569054 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.569037 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:48:07.569176 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:07.569159 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm" Nov 02 13:48:08.555059 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:48:08.555022 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:48:38.555156 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:48:38.555121 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:48:45.326908 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.326871 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9"] Nov 02 13:48:45.330346 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.330328 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.377124 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.377097 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9"] Nov 02 13:48:45.402477 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.402450 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Nov 02 13:48:45.402814 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.402796 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Nov 02 13:48:45.402902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.402876 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Nov 02 13:48:45.402974 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.402962 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-qdqbf\"" Nov 02 13:48:45.403013 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.402975 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Nov 02 13:48:45.403013 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.402975 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Nov 02 13:48:45.434453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.434424 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-tmp\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.434632 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.434463 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4j22\" (UniqueName: \"kubernetes.io/projected/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-kube-api-access-h4j22\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.434632 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.434606 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-manifests\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.434710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.434634 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.434710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.434659 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-webhook-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.434772 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.434709 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-metrics-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.535848 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.535818 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4j22\" (UniqueName: \"kubernetes.io/projected/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-kube-api-access-h4j22\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.536025 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.535885 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-manifests\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.536025 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.535913 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.536025 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.535938 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-webhook-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.536025 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.535974 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-metrics-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.536025 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.536013 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-tmp\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.536340 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.536299 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-manifests\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.538398 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.538371 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-tmp\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.538685 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.538667 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-webhook-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.538835 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.538813 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.538876 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.538813 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-metrics-cert\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.553857 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.553829 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4j22\" (UniqueName: \"kubernetes.io/projected/9ba634ce-29a2-4aa7-9446-25f7ab4dcb29-kube-api-access-h4j22\") pod \"opendatahub-operator-controller-manager-c559bd947-bzwc9\" (UID: \"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.645002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.644922 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:45.971272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.971221 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9"] Nov 02 13:48:45.975789 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:48:45.975764 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba634ce_29a2_4aa7_9446_25f7ab4dcb29.slice/crio-138ca41cb1cee83d6c5feb8c50794a3f7b15271875ee53c7047dae4f200a3fd7 WatchSource:0}: Error finding container 138ca41cb1cee83d6c5feb8c50794a3f7b15271875ee53c7047dae4f200a3fd7: Status 404 returned error can't find the container with id 138ca41cb1cee83d6c5feb8c50794a3f7b15271875ee53c7047dae4f200a3fd7 Nov 02 13:48:45.977365 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:45.977348 5081 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 13:48:46.729086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:46.729040 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" event={"ID":"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29","Type":"ContainerStarted","Data":"138ca41cb1cee83d6c5feb8c50794a3f7b15271875ee53c7047dae4f200a3fd7"} Nov 02 13:48:49.744433 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:49.744354 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" event={"ID":"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29","Type":"ContainerStarted","Data":"21f4f15963027cf0362beef18f9c8ce52d09d9df74185b42466aa981aad1018f"} Nov 02 13:48:50.750303 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:50.750267 5081 generic.go:356] "Generic (PLEG): container finished" podID="9ba634ce-29a2-4aa7-9446-25f7ab4dcb29" containerID="21f4f15963027cf0362beef18f9c8ce52d09d9df74185b42466aa981aad1018f" exitCode=0 Nov 02 13:48:50.750772 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:50.750356 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" event={"ID":"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29","Type":"ContainerDied","Data":"21f4f15963027cf0362beef18f9c8ce52d09d9df74185b42466aa981aad1018f"} Nov 02 13:48:51.756496 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:51.756462 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" event={"ID":"9ba634ce-29a2-4aa7-9446-25f7ab4dcb29","Type":"ContainerStarted","Data":"3a7551e7cfc411a2b73597052ccd7417ce1a1ed1819c8b5a4dde2e725df5425e"} Nov 02 13:48:51.757017 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:51.756580 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:48:51.804270 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:48:51.804216 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" podStartSLOduration=2.382555141 podStartE2EDuration="6.80420225s" totalImagesPullingTime="3.928664922s" totalInitContainerRuntime="492.982187ms" isStatefulPod=false podCreationTimestamp="2026-11-02 13:48:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:48:51.802308984 +0000 UTC m=+349.794697272" watchObservedRunningTime="2026-11-02 13:48:51.80420225 +0000 UTC m=+349.796590533" Nov 02 13:49:02.762937 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:02.762909 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-c559bd947-bzwc9" Nov 02 13:49:04.214473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.214438 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb"] Nov 02 13:49:04.221281 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.221264 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.232461 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.232437 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z78qf\"" Nov 02 13:49:04.232721 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.232706 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Nov 02 13:49:04.243323 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.243303 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Nov 02 13:49:04.280257 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.280225 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/784b4401-876e-4bc6-a77a-82195c5b1d61-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-xxvsb\" (UID: \"784b4401-876e-4bc6-a77a-82195c5b1d61\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.280441 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.280409 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87nzj\" (UniqueName: \"kubernetes.io/projected/784b4401-876e-4bc6-a77a-82195c5b1d61-kube-api-access-87nzj\") pod \"cert-manager-webhook-5dbbbf75cc-xxvsb\" (UID: \"784b4401-876e-4bc6-a77a-82195c5b1d61\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.288425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.288399 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb"] Nov 02 13:49:04.381163 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.381117 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87nzj\" (UniqueName: \"kubernetes.io/projected/784b4401-876e-4bc6-a77a-82195c5b1d61-kube-api-access-87nzj\") pod \"cert-manager-webhook-5dbbbf75cc-xxvsb\" (UID: \"784b4401-876e-4bc6-a77a-82195c5b1d61\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.381317 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.381180 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/784b4401-876e-4bc6-a77a-82195c5b1d61-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-xxvsb\" (UID: \"784b4401-876e-4bc6-a77a-82195c5b1d61\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.409722 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.409690 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87nzj\" (UniqueName: \"kubernetes.io/projected/784b4401-876e-4bc6-a77a-82195c5b1d61-kube-api-access-87nzj\") pod \"cert-manager-webhook-5dbbbf75cc-xxvsb\" (UID: \"784b4401-876e-4bc6-a77a-82195c5b1d61\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.415086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.415060 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/784b4401-876e-4bc6-a77a-82195c5b1d61-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-xxvsb\" (UID: \"784b4401-876e-4bc6-a77a-82195c5b1d61\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.546869 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.546791 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:04.852756 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:04.852734 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb"] Nov 02 13:49:04.854752 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:04.854724 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod784b4401_876e_4bc6_a77a_82195c5b1d61.slice/crio-4ce6fd9d6f8348a9185e2f4bea2a0a4ee2aaeb098fd5d0f6df660b8864aeddb2 WatchSource:0}: Error finding container 4ce6fd9d6f8348a9185e2f4bea2a0a4ee2aaeb098fd5d0f6df660b8864aeddb2: Status 404 returned error can't find the container with id 4ce6fd9d6f8348a9185e2f4bea2a0a4ee2aaeb098fd5d0f6df660b8864aeddb2 Nov 02 13:49:05.816111 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:05.816070 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" event={"ID":"784b4401-876e-4bc6-a77a-82195c5b1d61","Type":"ContainerStarted","Data":"4ce6fd9d6f8348a9185e2f4bea2a0a4ee2aaeb098fd5d0f6df660b8864aeddb2"} Nov 02 13:49:06.781809 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.781775 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv"] Nov 02 13:49:06.787074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.787050 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" Nov 02 13:49:06.823607 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.823581 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Nov 02 13:49:06.824574 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.824480 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Nov 02 13:49:06.824723 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.824583 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-q6zkn\"" Nov 02 13:49:06.824893 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.824868 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Nov 02 13:49:06.826726 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.826704 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv"] Nov 02 13:49:06.903245 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:06.903207 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlknd\" (UniqueName: \"kubernetes.io/projected/c5c3b940-2edd-4737-99a8-1906bde0b45d-kube-api-access-zlknd\") pod \"dns-operator-controller-manager-8557cbdb84-g69sv\" (UID: \"c5c3b940-2edd-4737-99a8-1906bde0b45d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" Nov 02 13:49:07.004176 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.004137 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlknd\" (UniqueName: \"kubernetes.io/projected/c5c3b940-2edd-4737-99a8-1906bde0b45d-kube-api-access-zlknd\") pod \"dns-operator-controller-manager-8557cbdb84-g69sv\" (UID: \"c5c3b940-2edd-4737-99a8-1906bde0b45d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" Nov 02 13:49:07.040292 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.040231 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlknd\" (UniqueName: \"kubernetes.io/projected/c5c3b940-2edd-4737-99a8-1906bde0b45d-kube-api-access-zlknd\") pod \"dns-operator-controller-manager-8557cbdb84-g69sv\" (UID: \"c5c3b940-2edd-4737-99a8-1906bde0b45d\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" Nov 02 13:49:07.102074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.102043 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" Nov 02 13:49:07.151019 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.150988 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6"] Nov 02 13:49:07.156080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.156041 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.166690 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.166663 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-lwxsp\"" Nov 02 13:49:07.177597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.177562 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6"] Nov 02 13:49:07.206436 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.206410 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a148207-b9ab-4e01-b349-cd5f08dab36a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7g5g6\" (UID: \"8a148207-b9ab-4e01-b349-cd5f08dab36a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.206436 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.206447 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q422k\" (UniqueName: \"kubernetes.io/projected/8a148207-b9ab-4e01-b349-cd5f08dab36a-kube-api-access-q422k\") pod \"cert-manager-cainjector-5c57bbd4fc-7g5g6\" (UID: \"8a148207-b9ab-4e01-b349-cd5f08dab36a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.307681 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.307612 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a148207-b9ab-4e01-b349-cd5f08dab36a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7g5g6\" (UID: \"8a148207-b9ab-4e01-b349-cd5f08dab36a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.307681 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.307651 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q422k\" (UniqueName: \"kubernetes.io/projected/8a148207-b9ab-4e01-b349-cd5f08dab36a-kube-api-access-q422k\") pod \"cert-manager-cainjector-5c57bbd4fc-7g5g6\" (UID: \"8a148207-b9ab-4e01-b349-cd5f08dab36a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.325030 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.325001 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a148207-b9ab-4e01-b349-cd5f08dab36a-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-7g5g6\" (UID: \"8a148207-b9ab-4e01-b349-cd5f08dab36a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.325814 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.325793 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q422k\" (UniqueName: \"kubernetes.io/projected/8a148207-b9ab-4e01-b349-cd5f08dab36a-kube-api-access-q422k\") pod \"cert-manager-cainjector-5c57bbd4fc-7g5g6\" (UID: \"8a148207-b9ab-4e01-b349-cd5f08dab36a\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.394955 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.394925 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv"] Nov 02 13:49:07.397571 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:07.397521 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c3b940_2edd_4737_99a8_1906bde0b45d.slice/crio-759b789369d3828235df48c3249d406af3a984afe2ab70b928762397039f7bff WatchSource:0}: Error finding container 759b789369d3828235df48c3249d406af3a984afe2ab70b928762397039f7bff: Status 404 returned error can't find the container with id 759b789369d3828235df48c3249d406af3a984afe2ab70b928762397039f7bff Nov 02 13:49:07.472384 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.472346 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" Nov 02 13:49:07.831505 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.831466 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" event={"ID":"c5c3b940-2edd-4737-99a8-1906bde0b45d","Type":"ContainerStarted","Data":"759b789369d3828235df48c3249d406af3a984afe2ab70b928762397039f7bff"} Nov 02 13:49:07.840082 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:07.840050 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6"] Nov 02 13:49:07.843750 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:07.843723 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a148207_b9ab_4e01_b349_cd5f08dab36a.slice/crio-29c605422e4dc3a37c75db969a65bcca4085e213519febfca3cc658fd1caa563 WatchSource:0}: Error finding container 29c605422e4dc3a37c75db969a65bcca4085e213519febfca3cc658fd1caa563: Status 404 returned error can't find the container with id 29c605422e4dc3a37c75db969a65bcca4085e213519febfca3cc658fd1caa563 Nov 02 13:49:08.555642 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:49:08.555603 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:49:08.840646 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:08.839896 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" event={"ID":"8a148207-b9ab-4e01-b349-cd5f08dab36a","Type":"ContainerStarted","Data":"0d2f2a02c05b5a00ba98adc4f37ea247ee85295dfff0e80beda3423f2fbd8f13"} Nov 02 13:49:08.840646 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:08.839949 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" event={"ID":"8a148207-b9ab-4e01-b349-cd5f08dab36a","Type":"ContainerStarted","Data":"29c605422e4dc3a37c75db969a65bcca4085e213519febfca3cc658fd1caa563"} Nov 02 13:49:08.843664 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:08.843630 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" event={"ID":"784b4401-876e-4bc6-a77a-82195c5b1d61","Type":"ContainerStarted","Data":"5a6be2b79cb06028cd3a63239a18217c0ee688c01cc6ff03696de0ad37211954"} Nov 02 13:49:08.844210 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:08.844190 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:08.932893 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:08.932835 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-7g5g6" podStartSLOduration=1.233363596 podStartE2EDuration="1.932814835s" totalImagesPullingTime="699.451239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:08.878150328 +0000 UTC m=+366.870538631" watchObservedRunningTime="2026-11-02 13:49:08.932814835 +0000 UTC m=+366.925203121" Nov 02 13:49:10.790577 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.790508 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" podStartSLOduration=3.325005667 podStartE2EDuration="6.790491039s" totalImagesPullingTime="3.465485372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:08.932709293 +0000 UTC m=+366.925097593" watchObservedRunningTime="2026-11-02 13:49:10.790491039 +0000 UTC m=+368.782879327" Nov 02 13:49:10.791234 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.791219 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz"] Nov 02 13:49:10.794625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.794609 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" Nov 02 13:49:10.804645 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.804621 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kkk9k\"" Nov 02 13:49:10.812899 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.812868 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz"] Nov 02 13:49:10.842927 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.842893 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtdmp\" (UniqueName: \"kubernetes.io/projected/daa68537-3d04-4e70-adf0-ee7423c6442d-kube-api-access-vtdmp\") pod \"authorino-operator-7b7bb4bc77-bxrxz\" (UID: \"daa68537-3d04-4e70-adf0-ee7423c6442d\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" Nov 02 13:49:10.855591 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.855556 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" event={"ID":"c5c3b940-2edd-4737-99a8-1906bde0b45d","Type":"ContainerStarted","Data":"ed05ee05b06ed665b97935b66bdbb467e54c3522888b78564848263e784ec18e"} Nov 02 13:49:10.896222 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.895462 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" podStartSLOduration=1.673336519 podStartE2EDuration="4.89544491s" totalImagesPullingTime="3.222108391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:10.894623868 +0000 UTC m=+368.887012164" watchObservedRunningTime="2026-11-02 13:49:10.89544491 +0000 UTC m=+368.887833197" Nov 02 13:49:10.945167 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.944404 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtdmp\" (UniqueName: \"kubernetes.io/projected/daa68537-3d04-4e70-adf0-ee7423c6442d-kube-api-access-vtdmp\") pod \"authorino-operator-7b7bb4bc77-bxrxz\" (UID: \"daa68537-3d04-4e70-adf0-ee7423c6442d\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" Nov 02 13:49:10.959759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:10.959726 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtdmp\" (UniqueName: \"kubernetes.io/projected/daa68537-3d04-4e70-adf0-ee7423c6442d-kube-api-access-vtdmp\") pod \"authorino-operator-7b7bb4bc77-bxrxz\" (UID: \"daa68537-3d04-4e70-adf0-ee7423c6442d\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" Nov 02 13:49:11.107331 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:11.107297 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" Nov 02 13:49:11.398694 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:11.398671 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz"] Nov 02 13:49:11.401361 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:11.401331 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa68537_3d04_4e70_adf0_ee7423c6442d.slice/crio-1cd515d3e35f13cbfe993561741211c55e7f84a5f0b02acc3252b3827376f834 WatchSource:0}: Error finding container 1cd515d3e35f13cbfe993561741211c55e7f84a5f0b02acc3252b3827376f834: Status 404 returned error can't find the container with id 1cd515d3e35f13cbfe993561741211c55e7f84a5f0b02acc3252b3827376f834 Nov 02 13:49:11.861352 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:11.861321 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" event={"ID":"daa68537-3d04-4e70-adf0-ee7423c6442d","Type":"ContainerStarted","Data":"1cd515d3e35f13cbfe993561741211c55e7f84a5f0b02acc3252b3827376f834"} Nov 02 13:49:11.861782 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:11.861440 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" Nov 02 13:49:13.872142 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:13.872108 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" event={"ID":"daa68537-3d04-4e70-adf0-ee7423c6442d","Type":"ContainerStarted","Data":"1d301b49472b812550cd22fb039d1efc3d4c52b7ec07d0d0afb3a0354557b70f"} Nov 02 13:49:13.872592 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:13.872234 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" Nov 02 13:49:13.902884 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:13.902837 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" podStartSLOduration=2.021595068 podStartE2EDuration="3.902823657s" totalImagesPullingTime="1.881228589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:13.902383151 +0000 UTC m=+371.894771434" watchObservedRunningTime="2026-11-02 13:49:13.902823657 +0000 UTC m=+371.895211941" Nov 02 13:49:15.858312 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:15.858283 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-xxvsb" Nov 02 13:49:16.979386 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:16.979347 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5"] Nov 02 13:49:16.983042 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:16.983021 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.015835 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.015812 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-tnthh\"" Nov 02 13:49:17.068740 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.068710 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5"] Nov 02 13:49:17.099380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099345 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099386 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099419 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099594 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099626 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099737 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099762 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vh5c\" (UniqueName: \"kubernetes.io/projected/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-kube-api-access-9vh5c\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099833 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.099916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.099850 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200471 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200433 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200493 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200509 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200558 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200575 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vh5c\" (UniqueName: \"kubernetes.io/projected/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-kube-api-access-9vh5c\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200617 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200640 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200989 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200741 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200989 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200818 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200989 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200911 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.200989 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.200927 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.201278 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.201247 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.201399 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.201376 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.201658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.201627 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.203390 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.203366 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.203706 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.203670 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.251260 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.251172 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vh5c\" (UniqueName: \"kubernetes.io/projected/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-kube-api-access-9vh5c\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.251499 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.251481 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/864086cc-7ea5-4d29-9465-ded1c7d9b6ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5\" (UID: \"864086cc-7ea5-4d29-9465-ded1c7d9b6ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.296035 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.295957 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:17.298383 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.298351 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-ltqm8"] Nov 02 13:49:17.302320 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.302301 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.335459 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.335424 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qmwbl\"" Nov 02 13:49:17.338468 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.338432 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-ltqm8"] Nov 02 13:49:17.402200 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.402165 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2f6acd-09b3-415c-9bac-94bd874e0768-bound-sa-token\") pod \"cert-manager-597b95cb84-ltqm8\" (UID: \"0e2f6acd-09b3-415c-9bac-94bd874e0768\") " pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.402425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.402401 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr4hp\" (UniqueName: \"kubernetes.io/projected/0e2f6acd-09b3-415c-9bac-94bd874e0768-kube-api-access-dr4hp\") pod \"cert-manager-597b95cb84-ltqm8\" (UID: \"0e2f6acd-09b3-415c-9bac-94bd874e0768\") " pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.503665 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.503579 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr4hp\" (UniqueName: \"kubernetes.io/projected/0e2f6acd-09b3-415c-9bac-94bd874e0768-kube-api-access-dr4hp\") pod \"cert-manager-597b95cb84-ltqm8\" (UID: \"0e2f6acd-09b3-415c-9bac-94bd874e0768\") " pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.503665 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.503626 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2f6acd-09b3-415c-9bac-94bd874e0768-bound-sa-token\") pod \"cert-manager-597b95cb84-ltqm8\" (UID: \"0e2f6acd-09b3-415c-9bac-94bd874e0768\") " pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.531905 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.531877 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0e2f6acd-09b3-415c-9bac-94bd874e0768-bound-sa-token\") pod \"cert-manager-597b95cb84-ltqm8\" (UID: \"0e2f6acd-09b3-415c-9bac-94bd874e0768\") " pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.532293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.532274 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr4hp\" (UniqueName: \"kubernetes.io/projected/0e2f6acd-09b3-415c-9bac-94bd874e0768-kube-api-access-dr4hp\") pod \"cert-manager-597b95cb84-ltqm8\" (UID: \"0e2f6acd-09b3-415c-9bac-94bd874e0768\") " pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.595252 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.595217 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5"] Nov 02 13:49:17.598416 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:17.598365 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod864086cc_7ea5_4d29_9465_ded1c7d9b6ca.slice/crio-ddb9f02e3d1391eed21c5558e888648523293f5e72af98922a32abaccf246919 WatchSource:0}: Error finding container ddb9f02e3d1391eed21c5558e888648523293f5e72af98922a32abaccf246919: Status 404 returned error can't find the container with id ddb9f02e3d1391eed21c5558e888648523293f5e72af98922a32abaccf246919 Nov 02 13:49:17.600750 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.600718 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:49:17.600824 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.600809 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:49:17.600861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.600840 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:49:17.625281 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.625262 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-ltqm8" Nov 02 13:49:17.892596 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.892485 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" event={"ID":"864086cc-7ea5-4d29-9465-ded1c7d9b6ca","Type":"ContainerStarted","Data":"26fe3caf752df2245408e32e15940a9533e76d58d034e91b27eba5a6afd506c5"} Nov 02 13:49:17.892759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.892596 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" event={"ID":"864086cc-7ea5-4d29-9465-ded1c7d9b6ca","Type":"ContainerStarted","Data":"ddb9f02e3d1391eed21c5558e888648523293f5e72af98922a32abaccf246919"} Nov 02 13:49:17.917558 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.917520 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-ltqm8"] Nov 02 13:49:17.919796 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:17.919770 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e2f6acd_09b3_415c_9bac_94bd874e0768.slice/crio-8bbbf94b09389167f5d9e5004fd51a7f4ee8b489686ef55c27996b21d460a70e WatchSource:0}: Error finding container 8bbbf94b09389167f5d9e5004fd51a7f4ee8b489686ef55c27996b21d460a70e: Status 404 returned error can't find the container with id 8bbbf94b09389167f5d9e5004fd51a7f4ee8b489686ef55c27996b21d460a70e Nov 02 13:49:17.930725 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:17.930681 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" podStartSLOduration=1.930668147 podStartE2EDuration="1.930668147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:17.929988516 +0000 UTC m=+375.922376822" watchObservedRunningTime="2026-11-02 13:49:17.930668147 +0000 UTC m=+375.923056430" Nov 02 13:49:18.296277 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.296243 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:18.300950 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.300925 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:18.547630 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.547548 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-k2fcs"] Nov 02 13:49:18.551149 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.551124 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" Nov 02 13:49:18.560810 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.560790 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r66x9\"" Nov 02 13:49:18.561394 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.561369 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-k2fcs"] Nov 02 13:49:18.614965 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.614934 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4nxw\" (UniqueName: \"kubernetes.io/projected/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34-kube-api-access-f4nxw\") pod \"authorino-57f7f8659f-k2fcs\" (UID: \"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34\") " pod="kuadrant-system/authorino-57f7f8659f-k2fcs" Nov 02 13:49:18.660337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.660302 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:49:18.664460 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.664434 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:18.686686 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.686649 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:49:18.698366 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.698343 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Nov 02 13:49:18.704280 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.704264 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6hrt4\"" Nov 02 13:49:18.716042 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.716017 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac632b97-36f6-4e77-91f0-72e2ea7accb7-config-file\") pod \"limitador-limitador-7c9b87d574-cwjw8\" (UID: \"ac632b97-36f6-4e77-91f0-72e2ea7accb7\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:18.716158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.716088 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4nxw\" (UniqueName: \"kubernetes.io/projected/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34-kube-api-access-f4nxw\") pod \"authorino-57f7f8659f-k2fcs\" (UID: \"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34\") " pod="kuadrant-system/authorino-57f7f8659f-k2fcs" Nov 02 13:49:18.716158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.716142 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9l47\" (UniqueName: \"kubernetes.io/projected/ac632b97-36f6-4e77-91f0-72e2ea7accb7-kube-api-access-h9l47\") pod \"limitador-limitador-7c9b87d574-cwjw8\" (UID: \"ac632b97-36f6-4e77-91f0-72e2ea7accb7\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:18.731804 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.731774 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:49:18.737497 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.737473 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4nxw\" (UniqueName: \"kubernetes.io/projected/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34-kube-api-access-f4nxw\") pod \"authorino-57f7f8659f-k2fcs\" (UID: \"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34\") " pod="kuadrant-system/authorino-57f7f8659f-k2fcs" Nov 02 13:49:18.817002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.816921 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac632b97-36f6-4e77-91f0-72e2ea7accb7-config-file\") pod \"limitador-limitador-7c9b87d574-cwjw8\" (UID: \"ac632b97-36f6-4e77-91f0-72e2ea7accb7\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:18.817002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.816981 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9l47\" (UniqueName: \"kubernetes.io/projected/ac632b97-36f6-4e77-91f0-72e2ea7accb7-kube-api-access-h9l47\") pod \"limitador-limitador-7c9b87d574-cwjw8\" (UID: \"ac632b97-36f6-4e77-91f0-72e2ea7accb7\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:18.817653 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.817629 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ac632b97-36f6-4e77-91f0-72e2ea7accb7-config-file\") pod \"limitador-limitador-7c9b87d574-cwjw8\" (UID: \"ac632b97-36f6-4e77-91f0-72e2ea7accb7\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:18.830677 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.830650 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9l47\" (UniqueName: \"kubernetes.io/projected/ac632b97-36f6-4e77-91f0-72e2ea7accb7-kube-api-access-h9l47\") pod \"limitador-limitador-7c9b87d574-cwjw8\" (UID: \"ac632b97-36f6-4e77-91f0-72e2ea7accb7\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:18.863645 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.863618 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" Nov 02 13:49:18.898949 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.898911 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-ltqm8" event={"ID":"0e2f6acd-09b3-415c-9bac-94bd874e0768","Type":"ContainerStarted","Data":"e476f029b217f3743739aae3cccc0cf1ec479ee8a2419b41bff41368bf53b8c8"} Nov 02 13:49:18.898949 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.898956 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-ltqm8" event={"ID":"0e2f6acd-09b3-415c-9bac-94bd874e0768","Type":"ContainerStarted","Data":"8bbbf94b09389167f5d9e5004fd51a7f4ee8b489686ef55c27996b21d460a70e"} Nov 02 13:49:18.899301 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.899287 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:18.900370 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.900352 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5" Nov 02 13:49:18.924977 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.919479 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-ltqm8" podStartSLOduration=1.919459078 podStartE2EDuration="1.919459078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:18.919008858 +0000 UTC m=+376.911397143" watchObservedRunningTime="2026-11-02 13:49:18.919459078 +0000 UTC m=+376.911847352" Nov 02 13:49:18.979836 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:18.979803 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:19.138907 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:19.138881 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-k2fcs"] Nov 02 13:49:19.141288 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:19.141262 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod860f1ba4_0c8d_4da3_8e2a_cd0d13a88d34.slice/crio-6ed20026e14217774d28ac4f0e14e9bcd988de996815c814f6532091855fd0f4 WatchSource:0}: Error finding container 6ed20026e14217774d28ac4f0e14e9bcd988de996815c814f6532091855fd0f4: Status 404 returned error can't find the container with id 6ed20026e14217774d28ac4f0e14e9bcd988de996815c814f6532091855fd0f4 Nov 02 13:49:19.260456 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:19.260433 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:49:19.262680 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:49:19.262650 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac632b97_36f6_4e77_91f0_72e2ea7accb7.slice/crio-dc1598b6f1a5923c1950103b40e678ae5c5d84a14711369eb11d623b54179492 WatchSource:0}: Error finding container dc1598b6f1a5923c1950103b40e678ae5c5d84a14711369eb11d623b54179492: Status 404 returned error can't find the container with id dc1598b6f1a5923c1950103b40e678ae5c5d84a14711369eb11d623b54179492 Nov 02 13:49:19.904899 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:19.904863 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" event={"ID":"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34","Type":"ContainerStarted","Data":"6ed20026e14217774d28ac4f0e14e9bcd988de996815c814f6532091855fd0f4"} Nov 02 13:49:19.906039 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:19.906012 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" event={"ID":"ac632b97-36f6-4e77-91f0-72e2ea7accb7","Type":"ContainerStarted","Data":"dc1598b6f1a5923c1950103b40e678ae5c5d84a14711369eb11d623b54179492"} Nov 02 13:49:21.852919 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:21.852882 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-k2fcs"] Nov 02 13:49:21.917312 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:21.917269 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" event={"ID":"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34","Type":"ContainerStarted","Data":"3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0"} Nov 02 13:49:21.918904 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:21.918874 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" event={"ID":"ac632b97-36f6-4e77-91f0-72e2ea7accb7","Type":"ContainerStarted","Data":"5f72f2bafeab59ce0424d8d17e43b259981f193775cd34aaa5a99ad22ab576ed"} Nov 02 13:49:21.919008 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:21.918979 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:21.955049 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:21.954998 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" podStartSLOduration=1.776419776 podStartE2EDuration="3.954985783s" totalImagesPullingTime="2.178566007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:21.954478601 +0000 UTC m=+379.946866885" watchObservedRunningTime="2026-11-02 13:49:21.954985783 +0000 UTC m=+379.947374066" Nov 02 13:49:21.979364 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:21.979315 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" podStartSLOduration=2.269497401 podStartE2EDuration="3.979301289s" totalImagesPullingTime="1.709803888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:49:21.977421372 +0000 UTC m=+379.969809656" watchObservedRunningTime="2026-11-02 13:49:21.979301289 +0000 UTC m=+379.971689572" Nov 02 13:49:22.868796 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:22.868762 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-g69sv" Nov 02 13:49:22.924828 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:22.924784 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" podUID="860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34" containerName="authorino" containerID="cri-o://3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0" gracePeriod=30 Nov 02 13:49:23.163341 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.163316 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" Nov 02 13:49:23.258662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.258632 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34-kube-api-access-f4nxw\" (UniqueName: \"kubernetes.io/projected/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34-kube-api-access-f4nxw\") pod \"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34\" (UID: \"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34\") " Nov 02 13:49:23.261051 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.261021 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34-kube-api-access-f4nxw" pod "860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34" (UID: "860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34"). InnerVolumeSpecName "kube-api-access-f4nxw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:49:23.359248 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.359206 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4nxw\" (UniqueName: \"kubernetes.io/projected/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34-kube-api-access-f4nxw\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:49:23.930354 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.930321 5081 generic.go:356] "Generic (PLEG): container finished" podID="860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34" containerID="3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0" exitCode=0 Nov 02 13:49:23.930916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.930370 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" Nov 02 13:49:23.930916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.930372 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" event={"ID":"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34","Type":"ContainerDied","Data":"3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0"} Nov 02 13:49:23.930916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.930501 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-k2fcs" event={"ID":"860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34","Type":"ContainerDied","Data":"6ed20026e14217774d28ac4f0e14e9bcd988de996815c814f6532091855fd0f4"} Nov 02 13:49:23.930916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.930554 5081 scope.go:122] "RemoveContainer" containerID="3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0" Nov 02 13:49:23.940403 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.940389 5081 scope.go:122] "RemoveContainer" containerID="3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0" Nov 02 13:49:23.940659 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:49:23.940642 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0\": container with ID starting with 3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0 not found: ID does not exist" containerID="3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0" Nov 02 13:49:23.940713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.940670 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0"} err="failed to get container status \"3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0\": rpc error: code = NotFound desc = could not find container \"3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0\": container with ID starting with 3cc7ff871d9a2292a24b23129f32efe683dd8a04f734d961df1ccda73ffd9cb0 not found: ID does not exist" Nov 02 13:49:23.966862 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.966837 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-k2fcs"] Nov 02 13:49:23.970879 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:23.970858 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-k2fcs"] Nov 02 13:49:24.135043 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:24.135010 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34" path="/var/lib/kubelet/pods/860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34/volumes" Nov 02 13:49:24.878270 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:24.878243 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-bxrxz" Nov 02 13:49:32.925696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:49:32.925667 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-cwjw8" Nov 02 13:49:38.555960 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:49:38.555922 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:50:08.554436 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:50:08.554365 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:50:13.828288 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.828228 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-n4vbh"] Nov 02 13:50:13.828693 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.828674 5081 cpu_manager.go:414] "containerMap: removing container" podUID="860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34" containerName="authorino" Nov 02 13:50:13.828693 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.828685 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34" containerName="authorino" Nov 02 13:50:13.828765 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.828758 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="860f1ba4-0c8d-4da3-8e2a-cd0d13a88d34" containerName="authorino" Nov 02 13:50:13.831786 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.831764 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:13.852679 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.852655 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Nov 02 13:50:13.852679 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.852671 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Nov 02 13:50:13.859028 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.858996 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-n4vbh"] Nov 02 13:50:13.876076 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.876048 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Nov 02 13:50:13.876231 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.876138 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hz8wj\"" Nov 02 13:50:13.922839 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.922807 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f19ac4-9ff5-4d13-b84d-871a496942cc-tls-certs\") pod \"model-serving-api-75bd89fdfc-n4vbh\" (UID: \"58f19ac4-9ff5-4d13-b84d-871a496942cc\") " pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:13.923006 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:13.922929 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghd9v\" (UniqueName: \"kubernetes.io/projected/58f19ac4-9ff5-4d13-b84d-871a496942cc-kube-api-access-ghd9v\") pod \"model-serving-api-75bd89fdfc-n4vbh\" (UID: \"58f19ac4-9ff5-4d13-b84d-871a496942cc\") " pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:14.023977 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:14.023942 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f19ac4-9ff5-4d13-b84d-871a496942cc-tls-certs\") pod \"model-serving-api-75bd89fdfc-n4vbh\" (UID: \"58f19ac4-9ff5-4d13-b84d-871a496942cc\") " pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:14.024246 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:14.023987 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghd9v\" (UniqueName: \"kubernetes.io/projected/58f19ac4-9ff5-4d13-b84d-871a496942cc-kube-api-access-ghd9v\") pod \"model-serving-api-75bd89fdfc-n4vbh\" (UID: \"58f19ac4-9ff5-4d13-b84d-871a496942cc\") " pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:14.026737 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:14.026713 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f19ac4-9ff5-4d13-b84d-871a496942cc-tls-certs\") pod \"model-serving-api-75bd89fdfc-n4vbh\" (UID: \"58f19ac4-9ff5-4d13-b84d-871a496942cc\") " pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:14.041162 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:14.041127 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghd9v\" (UniqueName: \"kubernetes.io/projected/58f19ac4-9ff5-4d13-b84d-871a496942cc-kube-api-access-ghd9v\") pod \"model-serving-api-75bd89fdfc-n4vbh\" (UID: \"58f19ac4-9ff5-4d13-b84d-871a496942cc\") " pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:14.146699 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:14.146604 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:14.437823 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:14.437799 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-n4vbh"] Nov 02 13:50:14.439899 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:50:14.439871 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f19ac4_9ff5_4d13_b84d_871a496942cc.slice/crio-74e25cab0ef4779568ebabc634a345a86fa503853c4b9944c524f6c8a79c2c42 WatchSource:0}: Error finding container 74e25cab0ef4779568ebabc634a345a86fa503853c4b9944c524f6c8a79c2c42: Status 404 returned error can't find the container with id 74e25cab0ef4779568ebabc634a345a86fa503853c4b9944c524f6c8a79c2c42 Nov 02 13:50:15.184175 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:15.184128 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" event={"ID":"58f19ac4-9ff5-4d13-b84d-871a496942cc","Type":"ContainerStarted","Data":"74e25cab0ef4779568ebabc634a345a86fa503853c4b9944c524f6c8a79c2c42"} Nov 02 13:50:17.181229 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.181193 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z"] Nov 02 13:50:17.184800 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.184783 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.192450 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.191616 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-source\"" Nov 02 13:50:17.192832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.192675 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-tls\"" Nov 02 13:50:17.193372 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.193349 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"usage-logs-tenancy-proxy-ca-bundle\"" Nov 02 13:50:17.193992 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.193926 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"usage-tenancy-proxy-dockercfg-cv98n\"" Nov 02 13:50:17.200377 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.199740 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z"] Nov 02 13:50:17.206013 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.205978 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" event={"ID":"58f19ac4-9ff5-4d13-b84d-871a496942cc","Type":"ContainerStarted","Data":"f47bd0861c46621172a3f66bd2ff4259ed71473000ec6836634484b45c1b2c53"} Nov 02 13:50:17.206145 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.206095 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:17.233504 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.233457 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" podStartSLOduration=2.407062321 podStartE2EDuration="4.233442814s" totalImagesPullingTime="1.826380493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:50:17.232782438 +0000 UTC m=+435.225170753" watchObservedRunningTime="2026-11-02 13:50:17.233442814 +0000 UTC m=+435.225831098" Nov 02 13:50:17.259810 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.259785 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e677365e-b580-428a-adfc-058ad9f4f4e9-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.259941 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.259829 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/e677365e-b580-428a-adfc-058ad9f4f4e9-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.259941 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.259859 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxbcm\" (UniqueName: \"kubernetes.io/projected/e677365e-b580-428a-adfc-058ad9f4f4e9-kube-api-access-nxbcm\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.260016 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.259964 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e677365e-b580-428a-adfc-058ad9f4f4e9-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.361192 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.361158 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e677365e-b580-428a-adfc-058ad9f4f4e9-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.361353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.361222 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/e677365e-b580-428a-adfc-058ad9f4f4e9-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.361353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.361279 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxbcm\" (UniqueName: \"kubernetes.io/projected/e677365e-b580-428a-adfc-058ad9f4f4e9-kube-api-access-nxbcm\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.361353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.361320 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e677365e-b580-428a-adfc-058ad9f4f4e9-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.362008 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.361983 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e677365e-b580-428a-adfc-058ad9f4f4e9-service-ca\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.362229 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.362210 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-source\" (UniqueName: \"kubernetes.io/configmap/e677365e-b580-428a-adfc-058ad9f4f4e9-proxy-source\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.363890 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.363871 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e677365e-b580-428a-adfc-058ad9f4f4e9-tls-cert\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.374403 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.374374 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxbcm\" (UniqueName: \"kubernetes.io/projected/e677365e-b580-428a-adfc-058ad9f4f4e9-kube-api-access-nxbcm\") pod \"usage-logs-tenancy-proxy-9c5d49bcd-6km7z\" (UID: \"e677365e-b580-428a-adfc-058ad9f4f4e9\") " pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.506984 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.506904 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:17.787259 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:17.787232 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z"] Nov 02 13:50:17.789666 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:50:17.789639 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode677365e_b580_428a_adfc_058ad9f4f4e9.slice/crio-a83c6ec95c0aba0cdf46d8ed823193dabd8318b2acf1c3a514af60f2b8586032 WatchSource:0}: Error finding container a83c6ec95c0aba0cdf46d8ed823193dabd8318b2acf1c3a514af60f2b8586032: Status 404 returned error can't find the container with id a83c6ec95c0aba0cdf46d8ed823193dabd8318b2acf1c3a514af60f2b8586032 Nov 02 13:50:18.212199 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:18.212164 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" event={"ID":"e677365e-b580-428a-adfc-058ad9f4f4e9","Type":"ContainerStarted","Data":"a83c6ec95c0aba0cdf46d8ed823193dabd8318b2acf1c3a514af60f2b8586032"} Nov 02 13:50:28.216987 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:28.216955 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-n4vbh" Nov 02 13:50:30.290549 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:30.290504 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" event={"ID":"e677365e-b580-428a-adfc-058ad9f4f4e9","Type":"ContainerStarted","Data":"8596c5a02a03ae47ea4215604efe71bd7313ca74b478667a8a94ff144bcca1d5"} Nov 02 13:50:30.290968 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:30.290651 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:30.310958 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:30.310895 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" podStartSLOduration=1.489335699 podStartE2EDuration="13.310877641s" totalImagesPullingTime="11.821541942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:50:30.310611753 +0000 UTC m=+448.303000038" watchObservedRunningTime="2026-11-02 13:50:30.310877641 +0000 UTC m=+448.303265926" Nov 02 13:50:38.554910 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:50:38.554872 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:50:41.300952 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:41.300924 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/usage-logs-tenancy-proxy-9c5d49bcd-6km7z" Nov 02 13:50:48.373486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:48.373454 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:50:57.026189 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.026154 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-zmz5l"] Nov 02 13:50:57.282857 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.282763 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-zmz5l"] Nov 02 13:50:57.282857 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.282818 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-zmz5l"] Nov 02 13:50:57.282857 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.282842 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2"] Nov 02 13:50:57.283163 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.282860 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" Nov 02 13:50:57.283267 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:50:57.283247 5081 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hq8mb], unattached volumes=[], failed to process volumes=[kube-api-access-hq8mb]: context canceled" pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" podUID="626f6b01-28c6-439b-ad5f-eaa36db06d47" Nov 02 13:50:57.312269 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.312246 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2"] Nov 02 13:50:57.312422 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.312346 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.316860 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.316842 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Nov 02 13:50:57.317090 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.317074 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Nov 02 13:50:57.318346 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.318324 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Nov 02 13:50:57.318453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.318355 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7dtkz\"" Nov 02 13:50:57.318453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.318358 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\"" Nov 02 13:50:57.338741 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.338712 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq8mb\" (UniqueName: \"kubernetes.io/projected/626f6b01-28c6-439b-ad5f-eaa36db06d47-kube-api-access-hq8mb\") pod \"authorino-6f6944bcdd-zmz5l\" (UID: \"626f6b01-28c6-439b-ad5f-eaa36db06d47\") " pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" Nov 02 13:50:57.424166 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.424138 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" Nov 02 13:50:57.440173 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.440147 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq8mb\" (UniqueName: \"kubernetes.io/projected/626f6b01-28c6-439b-ad5f-eaa36db06d47-kube-api-access-hq8mb\") pod \"authorino-6f6944bcdd-zmz5l\" (UID: \"626f6b01-28c6-439b-ad5f-eaa36db06d47\") " pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" Nov 02 13:50:57.440308 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.440192 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ebdc50-136a-4e70-939b-8b86ad69587a-openshift-service-ca\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.440308 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.440226 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs745\" (UniqueName: \"kubernetes.io/projected/01ebdc50-136a-4e70-939b-8b86ad69587a-kube-api-access-fs745\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.440428 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.440356 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-metrics-certs\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.440428 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.440379 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-maas-api-tls\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.483158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.483130 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" Nov 02 13:50:57.494253 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.494228 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq8mb\" (UniqueName: \"kubernetes.io/projected/626f6b01-28c6-439b-ad5f-eaa36db06d47-kube-api-access-hq8mb\") pod \"authorino-6f6944bcdd-zmz5l\" (UID: \"626f6b01-28c6-439b-ad5f-eaa36db06d47\") " pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" Nov 02 13:50:57.541037 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.540955 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/626f6b01-28c6-439b-ad5f-eaa36db06d47-kube-api-access-hq8mb\" (UniqueName: \"kubernetes.io/projected/626f6b01-28c6-439b-ad5f-eaa36db06d47-kube-api-access-hq8mb\") pod \"626f6b01-28c6-439b-ad5f-eaa36db06d47\" (UID: \"626f6b01-28c6-439b-ad5f-eaa36db06d47\") " Nov 02 13:50:57.541242 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.541214 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-metrics-certs\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.541370 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.541260 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-maas-api-tls\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.541420 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.541377 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ebdc50-136a-4e70-939b-8b86ad69587a-openshift-service-ca\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.541456 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.541441 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs745\" (UniqueName: \"kubernetes.io/projected/01ebdc50-136a-4e70-939b-8b86ad69587a-kube-api-access-fs745\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.542109 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.542039 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ebdc50-136a-4e70-939b-8b86ad69587a-openshift-service-ca\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.543371 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.543344 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/626f6b01-28c6-439b-ad5f-eaa36db06d47-kube-api-access-hq8mb" pod "626f6b01-28c6-439b-ad5f-eaa36db06d47" (UID: "626f6b01-28c6-439b-ad5f-eaa36db06d47"). InnerVolumeSpecName "kube-api-access-hq8mb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:50:57.543822 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.543800 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-maas-api-tls\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.543902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.543839 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-metrics-certs\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.575882 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.575853 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs745\" (UniqueName: \"kubernetes.io/projected/01ebdc50-136a-4e70-939b-8b86ad69587a-kube-api-access-fs745\") pod \"maas-api-8d54bcbb-57lz2\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.663544 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.642092 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq8mb\" (UniqueName: \"kubernetes.io/projected/626f6b01-28c6-439b-ad5f-eaa36db06d47-kube-api-access-hq8mb\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:50:57.663544 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.648965 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:50:57.942953 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:57.942884 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2"] Nov 02 13:50:57.945368 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:50:57.945345 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ebdc50_136a_4e70_939b_8b86ad69587a.slice/crio-65591194e0ca4c56bbffd8897f731fb87b4cf8544687ad1564bf29cd43393bce WatchSource:0}: Error finding container 65591194e0ca4c56bbffd8897f731fb87b4cf8544687ad1564bf29cd43393bce: Status 404 returned error can't find the container with id 65591194e0ca4c56bbffd8897f731fb87b4cf8544687ad1564bf29cd43393bce Nov 02 13:50:58.430820 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.430784 5081 generic.go:356] "Generic (PLEG): container finished" podID="10357ae6-63df-4967-8cc0-537b1e787d13" containerID="89ee1123a4db08c41891ddc0d24e237c7f25d230cbe56a0ce50eed7312fb90eb" exitCode=0 Nov 02 13:50:58.431282 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.430859 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" event={"ID":"10357ae6-63df-4967-8cc0-537b1e787d13","Type":"ContainerDied","Data":"89ee1123a4db08c41891ddc0d24e237c7f25d230cbe56a0ce50eed7312fb90eb"} Nov 02 13:50:58.431282 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.431257 5081 scope.go:122] "RemoveContainer" containerID="89ee1123a4db08c41891ddc0d24e237c7f25d230cbe56a0ce50eed7312fb90eb" Nov 02 13:50:58.432335 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.432314 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-zmz5l" Nov 02 13:50:58.432454 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.432311 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" event={"ID":"01ebdc50-136a-4e70-939b-8b86ad69587a","Type":"ContainerStarted","Data":"65591194e0ca4c56bbffd8897f731fb87b4cf8544687ad1564bf29cd43393bce"} Nov 02 13:50:58.432454 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.432414 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:50:58.432529 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.432479 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:50:58.432529 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.432510 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:50:58.485270 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.485241 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-zmz5l"] Nov 02 13:50:58.501686 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:58.501654 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-zmz5l"] Nov 02 13:50:59.463479 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:50:59.463445 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" event={"ID":"10357ae6-63df-4967-8cc0-537b1e787d13","Type":"ContainerStarted","Data":"0583dcc3458f14056a8829032866114275ee65bd28b5511bb4b2d22cf427b8dc"} Nov 02 13:51:00.160085 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:00.160040 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-dlq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 02 13:51:00.160295 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:00.160105 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" podUID="10357ae6-63df-4967-8cc0-537b1e787d13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 02 13:51:00.164852 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:00.164821 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="626f6b01-28c6-439b-ad5f-eaa36db06d47" path="/var/lib/kubelet/pods/626f6b01-28c6-439b-ad5f-eaa36db06d47/volumes" Nov 02 13:51:00.165107 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:00.165090 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:51:01.158790 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:01.158322 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-dlq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 02 13:51:01.158790 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:01.158382 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" podUID="10357ae6-63df-4967-8cc0-537b1e787d13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 02 13:51:02.159957 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:02.159916 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-dlq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 02 13:51:02.160468 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:02.159977 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" podUID="10357ae6-63df-4967-8cc0-537b1e787d13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 02 13:51:02.483095 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:02.483010 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" event={"ID":"01ebdc50-136a-4e70-939b-8b86ad69587a","Type":"ContainerStarted","Data":"deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d"} Nov 02 13:51:02.483258 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:02.483131 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:51:02.504094 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:02.504040 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" podStartSLOduration=1.842326147 podStartE2EDuration="5.504027442s" totalImagesPullingTime="3.661701295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:50:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:51:02.50361085 +0000 UTC m=+480.495999157" watchObservedRunningTime="2026-11-02 13:51:02.504027442 +0000 UTC m=+480.496415725" Nov 02 13:51:03.159991 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:03.159952 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-dlq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 02 13:51:03.160512 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:03.160018 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" podUID="10357ae6-63df-4967-8cc0-537b1e787d13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 02 13:51:04.159983 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:04.159937 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-dlq49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Nov 02 13:51:04.160154 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:04.159999 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" podUID="10357ae6-63df-4967-8cc0-537b1e787d13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Nov 02 13:51:05.160757 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:05.160727 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:51:05.161141 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:05.160998 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:51:05.161639 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:05.161625 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-dlq49" Nov 02 13:51:08.494665 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:51:08.494638 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 13:51:08.558645 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:51:08.558606 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:51:38.555310 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:51:38.555265 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:52:08.555019 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:52:08.554983 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:52:17.368495 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.368463 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z"] Nov 02 13:52:17.372151 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.372131 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.379807 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.379787 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lwlfp\"" Nov 02 13:52:17.383627 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.383607 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Nov 02 13:52:17.383750 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.383704 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Nov 02 13:52:17.385755 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.385732 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z"] Nov 02 13:52:17.480065 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.480034 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Nov 02 13:52:17.483416 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.483395 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53cbc84-390b-4287-9b3c-c2a626ea4b73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.483475 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.483435 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.483475 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.483452 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8xp\" (UniqueName: \"kubernetes.io/projected/a53cbc84-390b-4287-9b3c-c2a626ea4b73-kube-api-access-xn8xp\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.483571 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.483504 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.483634 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.483622 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.483670 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.483657 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.584580 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.584518 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.584759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.584604 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53cbc84-390b-4287-9b3c-c2a626ea4b73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.584759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.584635 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.584759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.584650 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8xp\" (UniqueName: \"kubernetes.io/projected/a53cbc84-390b-4287-9b3c-c2a626ea4b73-kube-api-access-xn8xp\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.584759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.584671 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.584759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.584706 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.585040 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.585003 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.585109 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.585089 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.585157 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.585112 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.587082 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.587062 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53cbc84-390b-4287-9b3c-c2a626ea4b73-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.587344 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.587324 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53cbc84-390b-4287-9b3c-c2a626ea4b73-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.597436 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.597417 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8xp\" (UniqueName: \"kubernetes.io/projected/a53cbc84-390b-4287-9b3c-c2a626ea4b73-kube-api-access-xn8xp\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-8mm6z\" (UID: \"a53cbc84-390b-4287-9b3c-c2a626ea4b73\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.688081 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.688053 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:17.897714 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.897680 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:52:17.985191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:17.985170 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z"] Nov 02 13:52:17.987327 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:17.987298 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53cbc84_390b_4287_9b3c_c2a626ea4b73.slice/crio-45b881e6bfd374e34ff7552859f153cb6f1c8063c5254faeeffb1dafceb15190 WatchSource:0}: Error finding container 45b881e6bfd374e34ff7552859f153cb6f1c8063c5254faeeffb1dafceb15190: Status 404 returned error can't find the container with id 45b881e6bfd374e34ff7552859f153cb6f1c8063c5254faeeffb1dafceb15190 Nov 02 13:52:18.841672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:18.841634 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" event={"ID":"a53cbc84-390b-4287-9b3c-c2a626ea4b73","Type":"ContainerStarted","Data":"45b881e6bfd374e34ff7552859f153cb6f1c8063c5254faeeffb1dafceb15190"} Nov 02 13:52:19.034891 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.034853 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj"] Nov 02 13:52:19.038975 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.038950 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.044768 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.044196 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Nov 02 13:52:19.052771 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.052742 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj"] Nov 02 13:52:19.201245 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.201206 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.201442 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.201264 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.201442 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.201396 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360b9bb9-71ce-448a-9e99-126db49086bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.201569 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.201460 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.201569 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.201485 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcwk\" (UniqueName: \"kubernetes.io/projected/360b9bb9-71ce-448a-9e99-126db49086bd-kube-api-access-mqcwk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.201569 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.201516 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302319 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302359 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcwk\" (UniqueName: \"kubernetes.io/projected/360b9bb9-71ce-448a-9e99-126db49086bd-kube-api-access-mqcwk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302387 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302428 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302451 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302502 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360b9bb9-71ce-448a-9e99-126db49086bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302892 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302861 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302955 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302868 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.302955 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.302913 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.304807 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.304755 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/360b9bb9-71ce-448a-9e99-126db49086bd-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.305107 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.305089 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/360b9bb9-71ce-448a-9e99-126db49086bd-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.315034 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.315011 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcwk\" (UniqueName: \"kubernetes.io/projected/360b9bb9-71ce-448a-9e99-126db49086bd-kube-api-access-mqcwk\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj\" (UID: \"360b9bb9-71ce-448a-9e99-126db49086bd\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.357019 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.356998 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:19.637179 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.637147 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj"] Nov 02 13:52:19.638744 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:19.638719 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod360b9bb9_71ce_448a_9e99_126db49086bd.slice/crio-ede48cb85025c1072f0dd810e237219c9e7aa437570d43b19a77baf596e85006 WatchSource:0}: Error finding container ede48cb85025c1072f0dd810e237219c9e7aa437570d43b19a77baf596e85006: Status 404 returned error can't find the container with id ede48cb85025c1072f0dd810e237219c9e7aa437570d43b19a77baf596e85006 Nov 02 13:52:19.665822 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.665788 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:52:19.848627 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.848587 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" event={"ID":"a53cbc84-390b-4287-9b3c-c2a626ea4b73","Type":"ContainerStarted","Data":"83451e820818e61e39879e8e19926b08d55503ad6a1fba88e432c512e0a8e0de"} Nov 02 13:52:19.849886 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.849862 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" event={"ID":"360b9bb9-71ce-448a-9e99-126db49086bd","Type":"ContainerStarted","Data":"ede48cb85025c1072f0dd810e237219c9e7aa437570d43b19a77baf596e85006"} Nov 02 13:52:19.873812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:19.873755 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" podStartSLOduration=1.528918838 podStartE2EDuration="2.873738417s" totalImagesPullingTime="1.344819579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:19.87146429 +0000 UTC m=+557.863852592" watchObservedRunningTime="2026-11-02 13:52:19.873738417 +0000 UTC m=+557.866126700" Nov 02 13:52:20.689056 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:20.689020 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:20.857420 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:20.857387 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" event={"ID":"360b9bb9-71ce-448a-9e99-126db49086bd","Type":"ContainerStarted","Data":"397dd63c832735d33190b9f8024a443b5a3942f9a9bf1450b498c2f8da39b3f4"} Nov 02 13:52:20.885492 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:20.885442 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" podStartSLOduration=1.603279181 podStartE2EDuration="1.885430137s" totalImagesPullingTime="282.150956ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:20.879239617 +0000 UTC m=+558.871627902" watchObservedRunningTime="2026-11-02 13:52:20.885430137 +0000 UTC m=+558.877818420" Nov 02 13:52:21.357931 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.357887 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:21.689892 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.689856 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-v9khs"] Nov 02 13:52:21.693560 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.693510 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.698376 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.698357 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\"" Nov 02 13:52:21.703701 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.703680 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-v9khs"] Nov 02 13:52:21.719337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.719313 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-home\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.719483 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.719346 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mnk9\" (UniqueName: \"kubernetes.io/projected/f6076240-cac1-457b-8202-c1102a566ddb-kube-api-access-6mnk9\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.719483 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.719370 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.719483 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.719472 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.719643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.719566 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6076240-cac1-457b-8202-c1102a566ddb-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.719643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.719637 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.820710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.820672 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-home\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.820902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.820720 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mnk9\" (UniqueName: \"kubernetes.io/projected/f6076240-cac1-457b-8202-c1102a566ddb-kube-api-access-6mnk9\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.820902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.820751 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.820902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.820774 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.820902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.820802 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6076240-cac1-457b-8202-c1102a566ddb-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.820902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.820841 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.821180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.821117 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-home\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.821238 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.821180 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.821238 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.821222 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.823213 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.823193 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6076240-cac1-457b-8202-c1102a566ddb-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.823504 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.823485 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6076240-cac1-457b-8202-c1102a566ddb-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:21.835739 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:21.835706 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mnk9\" (UniqueName: \"kubernetes.io/projected/f6076240-cac1-457b-8202-c1102a566ddb-kube-api-access-6mnk9\") pod \"echo-simulator-kserve-64b6f8f96c-v9khs\" (UID: \"f6076240-cac1-457b-8202-c1102a566ddb\") " pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:22.007228 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:22.007140 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:22.282425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:22.282398 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-v9khs"] Nov 02 13:52:22.285174 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:22.285146 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6076240_cac1_457b_8202_c1102a566ddb.slice/crio-aeedc5dabeeb70a26203be6c8f5b33be754d1f2edb48d6f16adb00ea83bf8127 WatchSource:0}: Error finding container aeedc5dabeeb70a26203be6c8f5b33be754d1f2edb48d6f16adb00ea83bf8127: Status 404 returned error can't find the container with id aeedc5dabeeb70a26203be6c8f5b33be754d1f2edb48d6f16adb00ea83bf8127 Nov 02 13:52:22.324129 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:22.324098 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:52:22.869380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:22.869345 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" event={"ID":"f6076240-cac1-457b-8202-c1102a566ddb","Type":"ContainerStarted","Data":"aeedc5dabeeb70a26203be6c8f5b33be754d1f2edb48d6f16adb00ea83bf8127"} Nov 02 13:52:24.012184 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.012143 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl"] Nov 02 13:52:24.016358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.016332 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.028812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.027452 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Nov 02 13:52:24.028812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.028566 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl"] Nov 02 13:52:24.041167 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.041137 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.041342 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.041189 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.041342 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.041251 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5118326d-d883-4097-95c2-a0c3c1d4b54f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.041480 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.041460 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh7sc\" (UniqueName: \"kubernetes.io/projected/5118326d-d883-4097-95c2-a0c3c1d4b54f-kube-api-access-kh7sc\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.041557 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.041496 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.041603 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.041580 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.142675 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.142649 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh7sc\" (UniqueName: \"kubernetes.io/projected/5118326d-d883-4097-95c2-a0c3c1d4b54f-kube-api-access-kh7sc\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.142812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.142681 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.142812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.142728 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.142812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.142761 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.142979 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.142834 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.142979 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.142882 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5118326d-d883-4097-95c2-a0c3c1d4b54f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.143220 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.143190 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.143310 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.143260 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.143530 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.143394 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.145826 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.145777 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5118326d-d883-4097-95c2-a0c3c1d4b54f-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.148606 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.146211 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5118326d-d883-4097-95c2-a0c3c1d4b54f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.155341 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.155318 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh7sc\" (UniqueName: \"kubernetes.io/projected/5118326d-d883-4097-95c2-a0c3c1d4b54f-kube-api-access-kh7sc\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl\" (UID: \"5118326d-d883-4097-95c2-a0c3c1d4b54f\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.334001 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.333917 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:24.608990 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.608968 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl"] Nov 02 13:52:24.611005 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:24.610981 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5118326d_d883_4097_95c2_a0c3c1d4b54f.slice/crio-81c8a0952d4b9eefaa017ddc80d0bc477c07ce6f751a93ebd0410f68ba1036c5 WatchSource:0}: Error finding container 81c8a0952d4b9eefaa017ddc80d0bc477c07ce6f751a93ebd0410f68ba1036c5: Status 404 returned error can't find the container with id 81c8a0952d4b9eefaa017ddc80d0bc477c07ce6f751a93ebd0410f68ba1036c5 Nov 02 13:52:24.823127 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.823097 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:52:24.888682 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.888594 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" event={"ID":"f6076240-cac1-457b-8202-c1102a566ddb","Type":"ContainerStarted","Data":"c52e46190ecdccd535806e7d1715e9772ef6c40e60ae43260d754d6d0af1a534"} Nov 02 13:52:24.889824 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.889797 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" event={"ID":"5118326d-d883-4097-95c2-a0c3c1d4b54f","Type":"ContainerStarted","Data":"81c8a0952d4b9eefaa017ddc80d0bc477c07ce6f751a93ebd0410f68ba1036c5"} Nov 02 13:52:24.949357 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:24.949312 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" podStartSLOduration=2.13513472 podStartE2EDuration="3.949298179s" totalImagesPullingTime="1.814163459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:24.948104886 +0000 UTC m=+562.940493170" watchObservedRunningTime="2026-11-02 13:52:24.949298179 +0000 UTC m=+562.941686464" Nov 02 13:52:25.007935 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:25.007905 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:25.898019 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:25.897977 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" event={"ID":"5118326d-d883-4097-95c2-a0c3c1d4b54f","Type":"ContainerStarted","Data":"3073a95ef777920d0b6a56b3d7fec893940fb6ae954e16151e7a8f6cfb8ff2bb"} Nov 02 13:52:25.917774 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:25.917703 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" podStartSLOduration=2.596969924 podStartE2EDuration="2.917683831s" totalImagesPullingTime="320.713907ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:25.91749789 +0000 UTC m=+563.909886196" watchObservedRunningTime="2026-11-02 13:52:25.917683831 +0000 UTC m=+563.910072117" Nov 02 13:52:26.334666 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:26.334635 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:27.046591 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.046563 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl"] Nov 02 13:52:27.050416 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.050395 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.058976 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.058954 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Nov 02 13:52:27.063335 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.061523 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl"] Nov 02 13:52:27.073890 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.073866 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.074009 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.073933 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.074079 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.074055 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.074124 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.074102 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/889344bf-3443-4d20-bc04-42d0ad58c833-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.074193 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.074169 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.074310 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.074284 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfng8\" (UniqueName: \"kubernetes.io/projected/889344bf-3443-4d20-bc04-42d0ad58c833-kube-api-access-nfng8\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.175177 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.175139 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.175486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.175203 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.175486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.175236 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/889344bf-3443-4d20-bc04-42d0ad58c833-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.175486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.175265 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.175486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.175290 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfng8\" (UniqueName: \"kubernetes.io/projected/889344bf-3443-4d20-bc04-42d0ad58c833-kube-api-access-nfng8\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.175486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.175333 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.176042 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.175829 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.176128 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.176084 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.176325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.176301 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.179676 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.179649 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/889344bf-3443-4d20-bc04-42d0ad58c833-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.179801 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.179711 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/889344bf-3443-4d20-bc04-42d0ad58c833-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.189913 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.189888 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfng8\" (UniqueName: \"kubernetes.io/projected/889344bf-3443-4d20-bc04-42d0ad58c833-kube-api-access-nfng8\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl\" (UID: \"889344bf-3443-4d20-bc04-42d0ad58c833\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.367827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.367720 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:27.653854 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.653719 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl"] Nov 02 13:52:27.660830 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:27.660791 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889344bf_3443_4d20_bc04_42d0ad58c833.slice/crio-f98c623c11656a53304d8b5a83444906da250881bd106d0414965b6a12c71228 WatchSource:0}: Error finding container f98c623c11656a53304d8b5a83444906da250881bd106d0414965b6a12c71228: Status 404 returned error can't find the container with id f98c623c11656a53304d8b5a83444906da250881bd106d0414965b6a12c71228 Nov 02 13:52:27.689282 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.689243 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:27.706407 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.706386 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:27.909889 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.909805 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" event={"ID":"889344bf-3443-4d20-bc04-42d0ad58c833","Type":"ContainerStarted","Data":"f98c623c11656a53304d8b5a83444906da250881bd106d0414965b6a12c71228"} Nov 02 13:52:27.921400 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:27.921374 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-8mm6z" Nov 02 13:52:28.426759 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:28.426727 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:52:28.918456 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:28.918422 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" event={"ID":"889344bf-3443-4d20-bc04-42d0ad58c833","Type":"ContainerStarted","Data":"19cb2fa488349bf729392bf82e619618f13d4848397452d57c83a59eb8a54741"} Nov 02 13:52:28.941156 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:28.941110 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" podStartSLOduration=1.6094889559999999 podStartE2EDuration="1.941094326s" totalImagesPullingTime="331.60537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:28.939976327 +0000 UTC m=+566.932364632" watchObservedRunningTime="2026-11-02 13:52:28.941094326 +0000 UTC m=+566.933482646" Nov 02 13:52:29.046719 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.046682 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq"] Nov 02 13:52:29.051116 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.051095 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.060354 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.060283 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq"] Nov 02 13:52:29.061207 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.061186 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Nov 02 13:52:29.099663 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.099633 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a201a29d-c69d-48d4-8835-2d52f505708c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.099663 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.099667 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.099910 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.099693 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.099910 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.099877 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.100003 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.099932 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql464\" (UniqueName: \"kubernetes.io/projected/a201a29d-c69d-48d4-8835-2d52f505708c-kube-api-access-ql464\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.100003 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.099996 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.200749 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.200661 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.200749 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.200725 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.200992 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.200768 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql464\" (UniqueName: \"kubernetes.io/projected/a201a29d-c69d-48d4-8835-2d52f505708c-kube-api-access-ql464\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.200992 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.200801 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.200992 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.200883 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a201a29d-c69d-48d4-8835-2d52f505708c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.200992 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.200933 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.201202 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.201185 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.201309 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.201288 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.201377 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.201286 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.203130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.203098 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a201a29d-c69d-48d4-8835-2d52f505708c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.203414 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.203394 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a201a29d-c69d-48d4-8835-2d52f505708c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.215023 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.214994 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql464\" (UniqueName: \"kubernetes.io/projected/a201a29d-c69d-48d4-8835-2d52f505708c-kube-api-access-ql464\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-ncjcq\" (UID: \"a201a29d-c69d-48d4-8835-2d52f505708c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.358227 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.358195 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:29.368056 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.368031 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:29.370956 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.370939 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:29.377581 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.377564 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:29.663294 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.663263 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq"] Nov 02 13:52:29.664721 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:29.664689 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda201a29d_c69d_48d4_8835_2d52f505708c.slice/crio-2d1bc5498a8222ae3f37135fb7d9029cd76c26063aa786b83a3094037a9239ea WatchSource:0}: Error finding container 2d1bc5498a8222ae3f37135fb7d9029cd76c26063aa786b83a3094037a9239ea: Status 404 returned error can't find the container with id 2d1bc5498a8222ae3f37135fb7d9029cd76c26063aa786b83a3094037a9239ea Nov 02 13:52:29.925069 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.924985 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" event={"ID":"a201a29d-c69d-48d4-8835-2d52f505708c","Type":"ContainerStarted","Data":"2d1bc5498a8222ae3f37135fb7d9029cd76c26063aa786b83a3094037a9239ea"} Nov 02 13:52:29.936864 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:29.936834 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj" Nov 02 13:52:30.933288 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:30.933250 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" event={"ID":"a201a29d-c69d-48d4-8835-2d52f505708c","Type":"ContainerStarted","Data":"65ee7be589c8c32e6aa06d783a3195eaa1f87e6fd269c2577656e97843eb3315"} Nov 02 13:52:30.957303 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:30.957253 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" podStartSLOduration=1.658776029 podStartE2EDuration="1.957236722s" totalImagesPullingTime="298.460693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:30.95537991 +0000 UTC m=+568.947768213" watchObservedRunningTime="2026-11-02 13:52:30.957236722 +0000 UTC m=+568.949625006" Nov 02 13:52:31.378317 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:31.378236 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:32.008336 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:32.008306 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:32.020884 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:32.020860 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:32.955414 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:32.955384 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-v9khs" Nov 02 13:52:33.329309 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:33.329220 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:52:34.334482 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:34.334446 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:34.347300 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:34.347277 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:34.965528 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:34.965502 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl" Nov 02 13:52:37.368221 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:37.368182 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:37.380809 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:37.380784 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:37.981643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:37.981613 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl" Nov 02 13:52:38.555607 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:52:38.555572 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:52:39.377756 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:39.377724 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:39.390041 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:39.390011 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:39.993111 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:39.993080 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-ncjcq" Nov 02 13:52:47.367672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.367589 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85"] Nov 02 13:52:47.375303 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.375265 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.393493 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.393467 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85"] Nov 02 13:52:47.483271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483233 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483281 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483308 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483380 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431cb77d-7b44-485d-93c8-9095ed1776f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483572 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483471 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483572 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483489 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483572 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483513 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pthx4\" (UniqueName: \"kubernetes.io/projected/431cb77d-7b44-485d-93c8-9095ed1776f0-kube-api-access-pthx4\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483701 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483585 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.483748 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.483711 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.584864 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.584830 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.584871 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.584899 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.584921 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431cb77d-7b44-485d-93c8-9095ed1776f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.584970 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.585001 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.585038 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pthx4\" (UniqueName: \"kubernetes.io/projected/431cb77d-7b44-485d-93c8-9095ed1776f0-kube-api-access-pthx4\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585397 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.585077 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585397 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.585112 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585397 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.585354 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.585411 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.585511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.585464 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.586315 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.586285 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431cb77d-7b44-485d-93c8-9095ed1776f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.586569 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.586526 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.587765 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.587742 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.587878 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.587863 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.602005 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.601980 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431cb77d-7b44-485d-93c8-9095ed1776f0-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.602551 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.602519 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pthx4\" (UniqueName: \"kubernetes.io/projected/431cb77d-7b44-485d-93c8-9095ed1776f0-kube-api-access-pthx4\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-n4k85\" (UID: \"431cb77d-7b44-485d-93c8-9095ed1776f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.690895 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.690864 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:47.976716 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.976644 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85"] Nov 02 13:52:47.978210 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:47.978183 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431cb77d_7b44_485d_93c8_9095ed1776f0.slice/crio-d93518a77e1c8ab53fcb6a99f7a585939bf863c356c56b6eb22e699415560035 WatchSource:0}: Error finding container d93518a77e1c8ab53fcb6a99f7a585939bf863c356c56b6eb22e699415560035: Status 404 returned error can't find the container with id d93518a77e1c8ab53fcb6a99f7a585939bf863c356c56b6eb22e699415560035 Nov 02 13:52:47.980808 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.980755 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:52:47.980910 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.980847 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:52:47.980910 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:47.980893 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:52:48.029520 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:48.029493 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" event={"ID":"431cb77d-7b44-485d-93c8-9095ed1776f0","Type":"ContainerStarted","Data":"d93518a77e1c8ab53fcb6a99f7a585939bf863c356c56b6eb22e699415560035"} Nov 02 13:52:49.057568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:49.053759 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" event={"ID":"431cb77d-7b44-485d-93c8-9095ed1776f0","Type":"ContainerStarted","Data":"343b075d85e2397268e88c921e1bb854b983d9719276e892c054fbc70307b34c"} Nov 02 13:52:49.086525 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:49.086470 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podStartSLOduration=2.086455786 podStartE2EDuration="2.086455786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:52:49.083664039 +0000 UTC m=+587.076052346" watchObservedRunningTime="2026-11-02 13:52:49.086455786 +0000 UTC m=+587.078844070" Nov 02 13:52:49.691419 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:49.691381 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:49.692963 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:49.692938 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 02 13:52:49.693066 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:49.692984 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 02 13:52:50.692168 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:50.692134 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 02 13:52:50.692630 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:50.692188 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 02 13:52:51.691819 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:51.691783 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 02 13:52:51.691994 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:51.691845 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 02 13:52:52.691557 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:52.691505 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 02 13:52:52.691964 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:52.691597 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 02 13:52:53.691964 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:53.691922 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 02 13:52:53.692453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:53.691976 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 02 13:52:54.691632 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:54.691597 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Nov 02 13:52:54.691825 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:54.691655 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Nov 02 13:52:56.225257 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:56.225212 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:56.226017 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:56.225985 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:56.227069 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:56.227050 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" Nov 02 13:52:57.955755 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:57.955721 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-746496c544-h9t8w"] Nov 02 13:52:57.963337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:57.963313 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:57.968462 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:57.968436 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\"" Nov 02 13:52:57.968611 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:57.968526 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\"" Nov 02 13:52:57.969831 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:57.969807 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-746496c544-h9t8w"] Nov 02 13:52:58.069057 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.069033 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-tmcwp\"" Nov 02 13:52:58.115461 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.115432 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de16c921-fa99-4f92-8da5-a08b09395f15-metrics-certs\") pod \"ai-gateway-controller-746496c544-h9t8w\" (UID: \"de16c921-fa99-4f92-8da5-a08b09395f15\") " pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:58.115659 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.115490 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt5q9\" (UniqueName: \"kubernetes.io/projected/de16c921-fa99-4f92-8da5-a08b09395f15-kube-api-access-tt5q9\") pod \"ai-gateway-controller-746496c544-h9t8w\" (UID: \"de16c921-fa99-4f92-8da5-a08b09395f15\") " pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:58.216645 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.216561 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt5q9\" (UniqueName: \"kubernetes.io/projected/de16c921-fa99-4f92-8da5-a08b09395f15-kube-api-access-tt5q9\") pod \"ai-gateway-controller-746496c544-h9t8w\" (UID: \"de16c921-fa99-4f92-8da5-a08b09395f15\") " pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:58.216807 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.216740 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de16c921-fa99-4f92-8da5-a08b09395f15-metrics-certs\") pod \"ai-gateway-controller-746496c544-h9t8w\" (UID: \"de16c921-fa99-4f92-8da5-a08b09395f15\") " pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:58.219429 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.219400 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de16c921-fa99-4f92-8da5-a08b09395f15-metrics-certs\") pod \"ai-gateway-controller-746496c544-h9t8w\" (UID: \"de16c921-fa99-4f92-8da5-a08b09395f15\") " pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:58.229564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.229509 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt5q9\" (UniqueName: \"kubernetes.io/projected/de16c921-fa99-4f92-8da5-a08b09395f15-kube-api-access-tt5q9\") pod \"ai-gateway-controller-746496c544-h9t8w\" (UID: \"de16c921-fa99-4f92-8da5-a08b09395f15\") " pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:58.284223 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.284189 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:52:58.560589 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:58.560530 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-746496c544-h9t8w"] Nov 02 13:52:58.562249 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:52:58.562217 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde16c921_fa99_4f92_8da5_a08b09395f15.slice/crio-389c0377af60a54ffaaefc16992e8f24e5fb363a0e81b01fafca653928e4253b WatchSource:0}: Error finding container 389c0377af60a54ffaaefc16992e8f24e5fb363a0e81b01fafca653928e4253b: Status 404 returned error can't find the container with id 389c0377af60a54ffaaefc16992e8f24e5fb363a0e81b01fafca653928e4253b Nov 02 13:52:59.118525 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:52:59.118494 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" event={"ID":"de16c921-fa99-4f92-8da5-a08b09395f15","Type":"ContainerStarted","Data":"389c0377af60a54ffaaefc16992e8f24e5fb363a0e81b01fafca653928e4253b"} Nov 02 13:53:01.131949 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:01.131912 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" event={"ID":"de16c921-fa99-4f92-8da5-a08b09395f15","Type":"ContainerStarted","Data":"76c0633d304d23bb7d3ecb2b453e782325e494b63c54df00ad5e7357a7344249"} Nov 02 13:53:01.132366 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:01.132044 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:53:01.152859 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:01.152811 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" podStartSLOduration=1.721043437 podStartE2EDuration="4.152797273s" totalImagesPullingTime="2.431753836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:01.150570737 +0000 UTC m=+599.142959021" watchObservedRunningTime="2026-11-02 13:53:01.152797273 +0000 UTC m=+599.145185874" Nov 02 13:53:02.199654 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.199626 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:53:02.201441 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.201420 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:53:02.359288 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.359252 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6"] Nov 02 13:53:02.363793 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.363765 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.378588 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.378560 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6"] Nov 02 13:53:02.460612 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460504 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.460612 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460567 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcvbt\" (UniqueName: \"kubernetes.io/projected/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-kube-api-access-hcvbt\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.460832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460616 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.460832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460632 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.460832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460703 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.460832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460732 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.460832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460800 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.461029 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460838 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.461029 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.460943 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562256 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562219 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562420 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562265 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562420 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562285 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcvbt\" (UniqueName: \"kubernetes.io/projected/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-kube-api-access-hcvbt\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562420 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562304 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562420 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562324 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562465 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562576 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562630 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562692 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562702 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562817 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.562986 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562971 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.563084 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.562966 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.563315 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.563299 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.565012 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.564989 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.565012 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.565002 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.580602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.580577 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.580888 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.580866 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcvbt\" (UniqueName: \"kubernetes.io/projected/7212b4c4-ccfc-495c-ba5b-1171ab72b7df-kube-api-access-hcvbt\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-h78x6\" (UID: \"7212b4c4-ccfc-495c-ba5b-1171ab72b7df\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.679032 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.679000 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:02.962203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.962170 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6"] Nov 02 13:53:02.965622 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:53:02.965587 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7212b4c4_ccfc_495c_ba5b_1171ab72b7df.slice/crio-2ccecde4076bcebccf56ec59ab762ebd20490a5c7fbb76c823430a357fc84c4f WatchSource:0}: Error finding container 2ccecde4076bcebccf56ec59ab762ebd20490a5c7fbb76c823430a357fc84c4f: Status 404 returned error can't find the container with id 2ccecde4076bcebccf56ec59ab762ebd20490a5c7fbb76c823430a357fc84c4f Nov 02 13:53:02.968283 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.968252 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:02.968340 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.968321 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:02.968388 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:02.968350 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:03.143453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:03.143419 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" event={"ID":"7212b4c4-ccfc-495c-ba5b-1171ab72b7df","Type":"ContainerStarted","Data":"78eddcf12550fd37d0e4214f2a620d0e433df3e55bc2342d4853f6941d3f137f"} Nov 02 13:53:03.143645 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:03.143472 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" event={"ID":"7212b4c4-ccfc-495c-ba5b-1171ab72b7df","Type":"ContainerStarted","Data":"2ccecde4076bcebccf56ec59ab762ebd20490a5c7fbb76c823430a357fc84c4f"} Nov 02 13:53:03.167793 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:03.167747 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podStartSLOduration=1.167721375 podStartE2EDuration="1.167721375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:03.165320593 +0000 UTC m=+601.157708893" watchObservedRunningTime="2026-11-02 13:53:03.167721375 +0000 UTC m=+601.160109660" Nov 02 13:53:03.680074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:03.680037 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:04.681394 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:04.681360 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 02 13:53:04.681796 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:04.681416 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 02 13:53:05.680046 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:05.680014 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 02 13:53:05.680234 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:05.680066 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 02 13:53:06.680096 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:06.680058 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 02 13:53:06.680566 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:06.680130 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 02 13:53:07.680094 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:07.680061 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 02 13:53:07.680272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:07.680124 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 02 13:53:08.580494 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:53:08.580407 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:53:08.679384 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:08.679349 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 02 13:53:08.679594 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:08.679415 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 02 13:53:09.679877 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:09.679833 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Nov 02 13:53:09.680310 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:09.679895 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Nov 02 13:53:11.224384 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:11.224355 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:11.224972 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:11.224786 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:11.225611 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:11.225584 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" Nov 02 13:53:12.138426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:12.138397 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-746496c544-h9t8w" Nov 02 13:53:38.556015 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:53:38.555978 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:53:49.855780 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.855742 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2"] Nov 02 13:53:49.859499 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.859484 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.872761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.872742 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-ee7df2-openshift-default-dockercfg-hc6nm\"" Nov 02 13:53:49.883176 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.883150 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2"] Nov 02 13:53:49.945602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945566 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzv54\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-kube-api-access-xzv54\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.945781 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945627 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.945781 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945726 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a482589f-cadc-4514-9380-8476579441b3-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.945871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945783 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.945871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945802 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.945871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945829 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.945871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945863 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a482589f-cadc-4514-9380-8476579441b3-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.946034 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945936 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:49.946034 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:49.945957 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.046734 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.046696 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.046929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.046740 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.046929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.046775 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.046929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.046796 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a482589f-cadc-4514-9380-8476579441b3-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.046929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.046859 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.046929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.046886 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047000 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzv54\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-kube-api-access-xzv54\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047043 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047070 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a482589f-cadc-4514-9380-8476579441b3-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047150 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047506 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047489 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047608 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047521 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047667 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047638 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.047917 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.047894 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a482589f-cadc-4514-9380-8476579441b3-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.049499 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.049476 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.050083 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.050062 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a482589f-cadc-4514-9380-8476579441b3-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.060927 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.060904 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.061189 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.061174 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzv54\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-kube-api-access-xzv54\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.101318 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.101287 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc"] Nov 02 13:53:50.106929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.106865 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.115929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.115606 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7a9443-openshift-default-dockercfg-m25kh\"" Nov 02 13:53:50.117916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.117891 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc"] Nov 02 13:53:50.148064 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.147982 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148071 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148129 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148173 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcdmv\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-kube-api-access-hcdmv\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148374 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148264 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482197d0-d58c-4b66-8b51-54479f513872-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148374 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148314 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148383 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148408 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.148443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.148433 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482197d0-d58c-4b66-8b51-54479f513872-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.173763 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.173741 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249509 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249647 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249676 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249702 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482197d0-d58c-4b66-8b51-54479f513872-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249731 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249772 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249827 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249873 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcdmv\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-kube-api-access-hcdmv\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.250080 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.249978 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482197d0-d58c-4b66-8b51-54479f513872-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.251062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.250750 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482197d0-d58c-4b66-8b51-54479f513872-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.252713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.251314 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.252713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.251498 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.252713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.252660 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.253254 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.253118 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.257381 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.257346 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.258287 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.258254 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482197d0-d58c-4b66-8b51-54479f513872-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.279095 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.279044 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcdmv\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-kube-api-access-hcdmv\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.280428 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.280385 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.424859 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.424823 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:50.463430 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.463399 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj"] Nov 02 13:53:50.468911 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.468871 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.483758 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.483738 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2"] Nov 02 13:53:50.487495 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.487307 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj"] Nov 02 13:53:50.488855 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:53:50.488827 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda482589f_cadc_4514_9380_8476579441b3.slice/crio-9cc51b07cf2ecee43467bf7d3cd0e7d2d8cd2491f51de225d1b5ae1e592a6ecd WatchSource:0}: Error finding container 9cc51b07cf2ecee43467bf7d3cd0e7d2d8cd2491f51de225d1b5ae1e592a6ecd: Status 404 returned error can't find the container with id 9cc51b07cf2ecee43467bf7d3cd0e7d2d8cd2491f51de225d1b5ae1e592a6ecd Nov 02 13:53:50.490804 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.490774 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:50.490890 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.490846 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:50.490958 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.490890 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:50.510764 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.510725 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-1d18fb-openshift-default-dockercfg-j42rt\"" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.552573 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd7pk\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-kube-api-access-hd7pk\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.552619 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.552693 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.552731 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.552773 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.552789 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.552951 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.553007 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.554689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.553062 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.653809 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.653775 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd7pk\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-kube-api-access-hd7pk\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.653987 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.653817 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.653987 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.653840 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654101 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654026 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654160 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654120 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654216 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654166 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654216 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654187 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654318 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654225 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654318 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654271 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654414 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654328 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654414 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654405 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654741 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654675 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654741 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654711 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.654941 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.654770 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.656732 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.656707 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.657036 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.657019 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.670359 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.670327 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.670522 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.670502 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd7pk\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-kube-api-access-hd7pk\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.751472 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.751439 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc"] Nov 02 13:53:50.780350 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:53:50.780305 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod482197d0_d58c_4b66_8b51_54479f513872.slice/crio-dff751a649bd3a4dd93c8f3d7afd1e92e4104d4a7158196db52dff5c07cb1fc4 WatchSource:0}: Error finding container dff751a649bd3a4dd93c8f3d7afd1e92e4104d4a7158196db52dff5c07cb1fc4: Status 404 returned error can't find the container with id dff751a649bd3a4dd93c8f3d7afd1e92e4104d4a7158196db52dff5c07cb1fc4 Nov 02 13:53:50.789967 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.789930 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:50.796599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.794608 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:50.796599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.794697 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:50.796599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:50.794769 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:51.085787 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.085761 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj"] Nov 02 13:53:51.088111 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:53:51.088083 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23c23fc_8ea5_4847_adf2_cac7f1ba0e03.slice/crio-f04582f9d45758f7dced1a91fdab96e51ccadd36d86ee80275a57410dad11b7c WatchSource:0}: Error finding container f04582f9d45758f7dced1a91fdab96e51ccadd36d86ee80275a57410dad11b7c: Status 404 returned error can't find the container with id f04582f9d45758f7dced1a91fdab96e51ccadd36d86ee80275a57410dad11b7c Nov 02 13:53:51.090861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.090827 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:51.090960 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.090902 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:51.090960 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.090936 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:53:51.418346 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.418312 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" event={"ID":"a482589f-cadc-4514-9380-8476579441b3","Type":"ContainerStarted","Data":"2bf9ba3147931b8f516fe15040c34d75e3e18b61b6e47fea9fb9284722db46e0"} Nov 02 13:53:51.418564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.418373 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" event={"ID":"a482589f-cadc-4514-9380-8476579441b3","Type":"ContainerStarted","Data":"9cc51b07cf2ecee43467bf7d3cd0e7d2d8cd2491f51de225d1b5ae1e592a6ecd"} Nov 02 13:53:51.420319 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.420291 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" event={"ID":"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03","Type":"ContainerStarted","Data":"aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3"} Nov 02 13:53:51.420450 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.420337 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" event={"ID":"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03","Type":"ContainerStarted","Data":"f04582f9d45758f7dced1a91fdab96e51ccadd36d86ee80275a57410dad11b7c"} Nov 02 13:53:51.422128 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.422092 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" event={"ID":"482197d0-d58c-4b66-8b51-54479f513872","Type":"ContainerStarted","Data":"01a6428a0e44bfb9ee4d53ead2bd62a6d683508362142207a3abb11825dc3650"} Nov 02 13:53:51.422218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.422135 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" event={"ID":"482197d0-d58c-4b66-8b51-54479f513872","Type":"ContainerStarted","Data":"dff751a649bd3a4dd93c8f3d7afd1e92e4104d4a7158196db52dff5c07cb1fc4"} Nov 02 13:53:51.425931 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.425913 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:51.431781 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.431763 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:51.448813 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.448762 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podStartSLOduration=2.448745947 podStartE2EDuration="2.448745947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:51.446779953 +0000 UTC m=+649.439168256" watchObservedRunningTime="2026-11-02 13:53:51.448745947 +0000 UTC m=+649.441134232" Nov 02 13:53:51.498218 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.498177 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podStartSLOduration=1.4981634050000001 podStartE2EDuration="1.498163405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:51.496198737 +0000 UTC m=+649.488587038" watchObservedRunningTime="2026-11-02 13:53:51.498163405 +0000 UTC m=+649.490551688" Nov 02 13:53:51.498516 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.498495 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podStartSLOduration=1.498490475 podStartE2EDuration="1.498490475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:51.471928154 +0000 UTC m=+649.464316438" watchObservedRunningTime="2026-11-02 13:53:51.498490475 +0000 UTC m=+649.490878762" Nov 02 13:53:51.790295 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:51.790219 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:52.174425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:52.174395 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:52.179395 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:52.179376 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:52.428744 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:52.428657 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:52.428744 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:52.428713 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:52.429489 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:52.429465 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:53:52.429670 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:52.429518 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:53:52.795740 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:52.795662 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:53.434662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:53.434634 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:53.435655 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:53.435639 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:53:55.315110 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.315076 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z"] Nov 02 13:53:55.319165 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.319145 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.334548 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.334511 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-9e0c2f\"" Nov 02 13:53:55.339934 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.339907 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z"] Nov 02 13:53:55.408190 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.408159 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ce893fe-d5d5-4c55-9a31-d76889d2567e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.408387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.408360 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9gq4\" (UniqueName: \"kubernetes.io/projected/4ce893fe-d5d5-4c55-9a31-d76889d2567e-kube-api-access-d9gq4\") pod \"payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.509784 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.509753 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ce893fe-d5d5-4c55-9a31-d76889d2567e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.509969 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.509926 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gq4\" (UniqueName: \"kubernetes.io/projected/4ce893fe-d5d5-4c55-9a31-d76889d2567e-kube-api-access-d9gq4\") pod \"payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.510617 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.510594 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ce893fe-d5d5-4c55-9a31-d76889d2567e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.534889 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.534862 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gq4\" (UniqueName: \"kubernetes.io/projected/4ce893fe-d5d5-4c55-9a31-d76889d2567e-kube-api-access-d9gq4\") pod \"payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.632331 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.632256 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:55.766169 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.766132 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv"] Nov 02 13:53:55.775023 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.774997 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:55.786694 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.786395 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-9e0c2f-serving-cert\"" Nov 02 13:53:55.789913 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.789890 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv"] Nov 02 13:53:55.915121 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.915085 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-maas-api-tls\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:55.915290 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.915130 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-metrics-certs\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:55.915334 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.915298 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3536ef66-306b-4eac-8aba-3b3c64e4fb17-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:55.915431 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.915414 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qrqj\" (UniqueName: \"kubernetes.io/projected/3536ef66-306b-4eac-8aba-3b3c64e4fb17-kube-api-access-6qrqj\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:55.939193 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.939156 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z"] Nov 02 13:53:55.949042 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:55.948998 5081 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 13:53:56.016212 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.016182 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qrqj\" (UniqueName: \"kubernetes.io/projected/3536ef66-306b-4eac-8aba-3b3c64e4fb17-kube-api-access-6qrqj\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.016385 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.016242 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-maas-api-tls\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.016385 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.016270 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-metrics-certs\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.016385 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.016335 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3536ef66-306b-4eac-8aba-3b3c64e4fb17-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.017163 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.017087 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3536ef66-306b-4eac-8aba-3b3c64e4fb17-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.018956 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.018933 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-maas-api-tls\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.019052 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.018953 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-metrics-certs\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.030248 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.030225 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qrqj\" (UniqueName: \"kubernetes.io/projected/3536ef66-306b-4eac-8aba-3b3c64e4fb17-kube-api-access-6qrqj\") pod \"maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.095907 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.095883 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:56.384056 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.384033 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv"] Nov 02 13:53:56.386690 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:53:56.386664 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3536ef66_306b_4eac_8aba_3b3c64e4fb17.slice/crio-9f03d41428de9e24116d8d09ee0b920909b03c4e396ac4c00fbfda9f2c4180c7 WatchSource:0}: Error finding container 9f03d41428de9e24116d8d09ee0b920909b03c4e396ac4c00fbfda9f2c4180c7: Status 404 returned error can't find the container with id 9f03d41428de9e24116d8d09ee0b920909b03c4e396ac4c00fbfda9f2c4180c7 Nov 02 13:53:56.453590 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.453552 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" event={"ID":"4ce893fe-d5d5-4c55-9a31-d76889d2567e","Type":"ContainerStarted","Data":"349e9fdea7b7711d6ab2f55726296a43efabe576476f292cf49f280dc8405b87"} Nov 02 13:53:56.454923 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:56.454896 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" event={"ID":"3536ef66-306b-4eac-8aba-3b3c64e4fb17","Type":"ContainerStarted","Data":"9f03d41428de9e24116d8d09ee0b920909b03c4e396ac4c00fbfda9f2c4180c7"} Nov 02 13:53:57.463995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:57.463956 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" event={"ID":"3536ef66-306b-4eac-8aba-3b3c64e4fb17","Type":"ContainerStarted","Data":"11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a"} Nov 02 13:53:57.464529 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:57.464089 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:53:57.487148 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:57.487101 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" podStartSLOduration=1.941881991 podStartE2EDuration="2.487085055s" totalImagesPullingTime="545.203064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:57.484147812 +0000 UTC m=+655.476536115" watchObservedRunningTime="2026-11-02 13:53:57.487085055 +0000 UTC m=+655.479473333" Nov 02 13:53:58.260388 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.260299 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm"] Nov 02 13:53:58.264716 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.264690 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.275342 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.273783 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-4fc49b-serving-cert\"" Nov 02 13:53:58.287169 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.285805 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm"] Nov 02 13:53:58.348210 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.348166 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2873d94d-fa24-4939-aff8-c318be872a69-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.348380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.348275 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-metrics-certs\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.348380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.348301 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwvs7\" (UniqueName: \"kubernetes.io/projected/2873d94d-fa24-4939-aff8-c318be872a69-kube-api-access-gwvs7\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.348491 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.348465 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-maas-api-tls\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.449872 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.449839 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-maas-api-tls\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.450060 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.449919 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2873d94d-fa24-4939-aff8-c318be872a69-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.450060 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.449945 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-metrics-certs\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.450060 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.449961 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwvs7\" (UniqueName: \"kubernetes.io/projected/2873d94d-fa24-4939-aff8-c318be872a69-kube-api-access-gwvs7\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.450771 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.450696 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2873d94d-fa24-4939-aff8-c318be872a69-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.452670 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.452647 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-maas-api-tls\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.452847 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.452828 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-metrics-certs\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.504503 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.504466 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwvs7\" (UniqueName: \"kubernetes.io/projected/2873d94d-fa24-4939-aff8-c318be872a69-kube-api-access-gwvs7\") pod \"maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.598225 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.598203 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:58.885172 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:58.885140 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm"] Nov 02 13:53:58.886712 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:53:58.886668 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2873d94d_fa24_4939_aff8_c318be872a69.slice/crio-cc8e47ee223ff0832cccc6afb7cdd4b73374523d9caa612a7abea978597c0677 WatchSource:0}: Error finding container cc8e47ee223ff0832cccc6afb7cdd4b73374523d9caa612a7abea978597c0677: Status 404 returned error can't find the container with id cc8e47ee223ff0832cccc6afb7cdd4b73374523d9caa612a7abea978597c0677 Nov 02 13:53:59.095884 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.095852 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj"] Nov 02 13:53:59.101104 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.101077 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.115000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.114976 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w2-ee7df2-dockercfg-f42bp\"" Nov 02 13:53:59.115260 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.115231 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w2-ee7df2\"" Nov 02 13:53:59.118010 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.117983 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj"] Nov 02 13:53:59.158753 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.158723 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnr5p\" (UniqueName: \"kubernetes.io/projected/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-kube-api-access-fnr5p\") pod \"payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.158926 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.158908 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.259517 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.259481 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.259713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.259571 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnr5p\" (UniqueName: \"kubernetes.io/projected/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-kube-api-access-fnr5p\") pod \"payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.260304 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.260284 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.275454 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.275426 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnr5p\" (UniqueName: \"kubernetes.io/projected/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-kube-api-access-fnr5p\") pod \"payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.411272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.411178 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:53:59.415799 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.415762 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:53:59.525879 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.525840 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" event={"ID":"4ce893fe-d5d5-4c55-9a31-d76889d2567e","Type":"ContainerStarted","Data":"ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b"} Nov 02 13:53:59.526383 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.525984 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:53:59.527793 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.527766 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" event={"ID":"2873d94d-fa24-4939-aff8-c318be872a69","Type":"ContainerStarted","Data":"e5a062dd19c8b54ca08657243fb4ff8b682df7f8d1a74556f9809e623694c1c1"} Nov 02 13:53:59.527928 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.527814 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" event={"ID":"2873d94d-fa24-4939-aff8-c318be872a69","Type":"ContainerStarted","Data":"cc8e47ee223ff0832cccc6afb7cdd4b73374523d9caa612a7abea978597c0677"} Nov 02 13:53:59.527928 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.527853 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:53:59.560220 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.560174 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" podStartSLOduration=2.051296843 podStartE2EDuration="4.560159259s" totalImagesPullingTime="2.508862416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:59.558422447 +0000 UTC m=+657.550810751" watchObservedRunningTime="2026-11-02 13:53:59.560159259 +0000 UTC m=+657.552547542" Nov 02 13:53:59.595434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.595379 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" podStartSLOduration=1.155864705 podStartE2EDuration="1.59536482s" totalImagesPullingTime="439.500115ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:53:59.592157582 +0000 UTC m=+657.584545866" watchObservedRunningTime="2026-11-02 13:53:59.59536482 +0000 UTC m=+657.587753105" Nov 02 13:53:59.624395 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.624367 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj"] Nov 02 13:53:59.630239 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.630219 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:53:59.646767 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.646746 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj"] Nov 02 13:53:59.664473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.664402 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj25g\" (UniqueName: \"kubernetes.io/projected/33df33e4-615f-4113-92ac-55e523b1f4a2-kube-api-access-hj25g\") pod \"payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:53:59.664473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.664449 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33df33e4-615f-4113-92ac-55e523b1f4a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:53:59.705273 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.705245 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-7a9443\"" Nov 02 13:53:59.705443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.705356 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-7a9443-dockercfg-tj2w2\"" Nov 02 13:53:59.714998 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.714977 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj"] Nov 02 13:53:59.716812 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:53:59.716787 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741f4b41_95c3_46d3_9951_8cb43f2c1b9e.slice/crio-d97bb87875e6967613b5ead6843c381b4aad064bf2668b9678dd59423c4c1901 WatchSource:0}: Error finding container d97bb87875e6967613b5ead6843c381b4aad064bf2668b9678dd59423c4c1901: Status 404 returned error can't find the container with id d97bb87875e6967613b5ead6843c381b4aad064bf2668b9678dd59423c4c1901 Nov 02 13:53:59.766132 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.766099 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj25g\" (UniqueName: \"kubernetes.io/projected/33df33e4-615f-4113-92ac-55e523b1f4a2-kube-api-access-hj25g\") pod \"payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:53:59.766334 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.766172 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33df33e4-615f-4113-92ac-55e523b1f4a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:53:59.767016 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.766992 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33df33e4-615f-4113-92ac-55e523b1f4a2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:53:59.826566 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.817059 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj25g\" (UniqueName: \"kubernetes.io/projected/33df33e4-615f-4113-92ac-55e523b1f4a2-kube-api-access-hj25g\") pod \"payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:53:59.948425 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:53:59.948352 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:54:00.234714 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.234678 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj"] Nov 02 13:54:00.236052 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:54:00.236023 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33df33e4_615f_4113_92ac_55e523b1f4a2.slice/crio-6232f01d9bec425c73aabaeb0d94826b4415e4a0c9248b372b9bb2af78c411e4 WatchSource:0}: Error finding container 6232f01d9bec425c73aabaeb0d94826b4415e4a0c9248b372b9bb2af78c411e4: Status 404 returned error can't find the container with id 6232f01d9bec425c73aabaeb0d94826b4415e4a0c9248b372b9bb2af78c411e4 Nov 02 13:54:00.534581 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.534462 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" event={"ID":"33df33e4-615f-4113-92ac-55e523b1f4a2","Type":"ContainerStarted","Data":"6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259"} Nov 02 13:54:00.534581 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.534518 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" event={"ID":"33df33e4-615f-4113-92ac-55e523b1f4a2","Type":"ContainerStarted","Data":"6232f01d9bec425c73aabaeb0d94826b4415e4a0c9248b372b9bb2af78c411e4"} Nov 02 13:54:00.535027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.534589 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:54:00.536131 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.536102 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" event={"ID":"741f4b41-95c3-46d3-9951-8cb43f2c1b9e","Type":"ContainerStarted","Data":"e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc"} Nov 02 13:54:00.536267 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.536152 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" event={"ID":"741f4b41-95c3-46d3-9951-8cb43f2c1b9e","Type":"ContainerStarted","Data":"d97bb87875e6967613b5ead6843c381b4aad064bf2668b9678dd59423c4c1901"} Nov 02 13:54:00.559623 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.559568 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" podStartSLOduration=1.559549719 podStartE2EDuration="1.559549719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:00.556700161 +0000 UTC m=+658.549088458" watchObservedRunningTime="2026-11-02 13:54:00.559549719 +0000 UTC m=+658.551937998" Nov 02 13:54:00.576851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.576807 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" podStartSLOduration=1.576792015 podStartE2EDuration="1.576792015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:00.574149392 +0000 UTC m=+658.566537696" watchObservedRunningTime="2026-11-02 13:54:00.576792015 +0000 UTC m=+658.569180299" Nov 02 13:54:00.926422 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.926382 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr"] Nov 02 13:54:00.937582 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.931610 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:00.944265 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.944238 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-1d18fb-serving-cert\"" Nov 02 13:54:00.948910 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.948127 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr"] Nov 02 13:54:00.980976 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.980923 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cnct\" (UniqueName: \"kubernetes.io/projected/3b408780-90b6-41ce-9ec0-ffc601d3ba67-kube-api-access-7cnct\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:00.981191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.981054 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408780-90b6-41ce-9ec0-ffc601d3ba67-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:00.981191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.981152 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-metrics-certs\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:00.981191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:00.981172 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-maas-api-tls\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.082282 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.082245 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cnct\" (UniqueName: \"kubernetes.io/projected/3b408780-90b6-41ce-9ec0-ffc601d3ba67-kube-api-access-7cnct\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.082477 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.082318 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408780-90b6-41ce-9ec0-ffc601d3ba67-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.082477 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.082407 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-metrics-certs\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.082477 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.082424 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-maas-api-tls\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.083071 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.083047 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408780-90b6-41ce-9ec0-ffc601d3ba67-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.085038 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.085016 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-maas-api-tls\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.085148 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.085102 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-metrics-certs\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.102258 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.102234 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cnct\" (UniqueName: \"kubernetes.io/projected/3b408780-90b6-41ce-9ec0-ffc601d3ba67-kube-api-access-7cnct\") pod \"maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.254050 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.253892 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:01.541752 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.541650 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:54:01.548420 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:01.548396 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr"] Nov 02 13:54:01.548760 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:54:01.548740 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b408780_90b6_41ce_9ec0_ffc601d3ba67.slice/crio-dd2999b37497d7dad99084ce61448536e0b3488028a6c59ad8f3c183ebe7e461 WatchSource:0}: Error finding container dd2999b37497d7dad99084ce61448536e0b3488028a6c59ad8f3c183ebe7e461: Status 404 returned error can't find the container with id dd2999b37497d7dad99084ce61448536e0b3488028a6c59ad8f3c183ebe7e461 Nov 02 13:54:02.547912 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.547875 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" event={"ID":"3b408780-90b6-41ce-9ec0-ffc601d3ba67","Type":"ContainerStarted","Data":"d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321"} Nov 02 13:54:02.548327 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.548065 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:02.548327 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.548109 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" event={"ID":"3b408780-90b6-41ce-9ec0-ffc601d3ba67","Type":"ContainerStarted","Data":"dd2999b37497d7dad99084ce61448536e0b3488028a6c59ad8f3c183ebe7e461"} Nov 02 13:54:02.570200 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.570153 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" podStartSLOduration=2.192065734 podStartE2EDuration="2.570138939s" totalImagesPullingTime="378.073205ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:02.568184053 +0000 UTC m=+660.560572339" watchObservedRunningTime="2026-11-02 13:54:02.570138939 +0000 UTC m=+660.562527222" Nov 02 13:54:02.728889 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.728855 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h"] Nov 02 13:54:02.734176 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.734150 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.746406 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.746369 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-7a9443-serving-cert\"" Nov 02 13:54:02.751027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.751005 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h"] Nov 02 13:54:02.802106 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.802024 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afacadb4-19ec-4ef4-a556-f38b251c7b81-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.802106 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.802073 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-metrics-certs\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.802345 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.802248 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55jp6\" (UniqueName: \"kubernetes.io/projected/afacadb4-19ec-4ef4-a556-f38b251c7b81-kube-api-access-55jp6\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.802390 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.802350 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.904029 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.903999 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afacadb4-19ec-4ef4-a556-f38b251c7b81-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.904180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.904056 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-metrics-certs\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.904180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.904125 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55jp6\" (UniqueName: \"kubernetes.io/projected/afacadb4-19ec-4ef4-a556-f38b251c7b81-kube-api-access-55jp6\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.904180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.904169 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.904921 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.904847 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afacadb4-19ec-4ef4-a556-f38b251c7b81-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.906781 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.906751 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-metrics-certs\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.906874 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.906756 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-maas-api-tls\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:02.920906 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:02.918319 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55jp6\" (UniqueName: \"kubernetes.io/projected/afacadb4-19ec-4ef4-a556-f38b251c7b81-kube-api-access-55jp6\") pod \"maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:03.058315 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:03.058235 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:03.352093 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:03.352063 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h"] Nov 02 13:54:03.352666 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:54:03.352633 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafacadb4_19ec_4ef4_a556_f38b251c7b81.slice/crio-62dc83c3396cc4562c9ff721cc05029e2db1353cb589d0d1a3737b1baa8c9106 WatchSource:0}: Error finding container 62dc83c3396cc4562c9ff721cc05029e2db1353cb589d0d1a3737b1baa8c9106: Status 404 returned error can't find the container with id 62dc83c3396cc4562c9ff721cc05029e2db1353cb589d0d1a3737b1baa8c9106 Nov 02 13:54:03.523579 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:03.523528 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 13:54:03.560006 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:03.559967 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" event={"ID":"afacadb4-19ec-4ef4-a556-f38b251c7b81","Type":"ContainerStarted","Data":"62dc83c3396cc4562c9ff721cc05029e2db1353cb589d0d1a3737b1baa8c9106"} Nov 02 13:54:04.363803 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:04.363771 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:54:04.576071 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:04.569524 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" event={"ID":"afacadb4-19ec-4ef4-a556-f38b251c7b81","Type":"ContainerStarted","Data":"c669f8506c7918e3c81199826566815055b325536cca1918064931186fb8ce71"} Nov 02 13:54:04.576071 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:04.569735 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:04.596814 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:04.596770 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" podStartSLOduration=2.213487719 podStartE2EDuration="2.596756012s" totalImagesPullingTime="383.268293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:04.595609776 +0000 UTC m=+662.587998060" watchObservedRunningTime="2026-11-02 13:54:04.596756012 +0000 UTC m=+662.589144296" Nov 02 13:54:05.561799 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:05.561761 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 13:54:08.591561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:08.591379 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:54:08.601015 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:54:08.600982 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:54:10.571561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:10.570715 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 13:54:10.597028 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:10.596980 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 13:54:10.830712 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:10.827386 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:54:11.564853 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:11.564760 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 13:54:12.560568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:12.560498 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 13:54:16.689504 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.689461 5081 generic.go:356] "Generic (PLEG): container finished" podID="482197d0-d58c-4b66-8b51-54479f513872" containerID="01a6428a0e44bfb9ee4d53ead2bd62a6d683508362142207a3abb11825dc3650" exitCode=0 Nov 02 13:54:16.690164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.689575 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" event={"ID":"482197d0-d58c-4b66-8b51-54479f513872","Type":"ContainerDied","Data":"01a6428a0e44bfb9ee4d53ead2bd62a6d683508362142207a3abb11825dc3650"} Nov 02 13:54:16.690164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.690052 5081 scope.go:122] "RemoveContainer" containerID="01a6428a0e44bfb9ee4d53ead2bd62a6d683508362142207a3abb11825dc3650" Nov 02 13:54:16.692658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.691854 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:16.692658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.691947 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:16.692658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.691993 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:16.694737 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.694716 5081 generic.go:356] "Generic (PLEG): container finished" podID="a482589f-cadc-4514-9380-8476579441b3" containerID="2bf9ba3147931b8f516fe15040c34d75e3e18b61b6e47fea9fb9284722db46e0" exitCode=0 Nov 02 13:54:16.694856 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.694818 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" event={"ID":"a482589f-cadc-4514-9380-8476579441b3","Type":"ContainerDied","Data":"2bf9ba3147931b8f516fe15040c34d75e3e18b61b6e47fea9fb9284722db46e0"} Nov 02 13:54:16.695236 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.695219 5081 scope.go:122] "RemoveContainer" containerID="2bf9ba3147931b8f516fe15040c34d75e3e18b61b6e47fea9fb9284722db46e0" Nov 02 13:54:16.710583 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.702080 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:16.710583 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.702169 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:16.710583 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:16.702211 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:17.705861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:17.705823 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" event={"ID":"a482589f-cadc-4514-9380-8476579441b3","Type":"ContainerStarted","Data":"1d77b7ce1515cc4696d232accab9de9ada111ba34fb38eb5077b26c148084bb4"} Nov 02 13:54:17.707701 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:17.707679 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" event={"ID":"482197d0-d58c-4b66-8b51-54479f513872","Type":"ContainerStarted","Data":"c9052e6aeaca2781e9a641d516fd501d094f6613b33acc2b4ec6e109a3b5e81b"} Nov 02 13:54:18.189488 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:18.187768 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:54:18.189488 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:18.189070 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 02 13:54:18.189488 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:18.189141 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 02 13:54:18.425885 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:18.425854 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:54:18.427150 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:18.427123 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 02 13:54:18.427307 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:18.427181 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 02 13:54:19.176561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:19.176005 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 02 13:54:19.176561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:19.176071 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 02 13:54:19.425779 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:19.425746 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 02 13:54:19.425974 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:19.425810 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 02 13:54:20.176002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:20.175562 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 02 13:54:20.176002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:20.175632 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 02 13:54:20.426252 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:20.426179 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 02 13:54:20.426252 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:20.426230 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 02 13:54:20.718129 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:20.718043 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:54:21.174956 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:21.174922 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 02 13:54:21.175380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:21.175352 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 02 13:54:21.425443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:21.425370 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 02 13:54:21.425647 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:21.425617 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 02 13:54:22.189585 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.177458 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 02 13:54:22.189585 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.177852 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 02 13:54:22.425237 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.425202 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Nov 02 13:54:22.425400 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.425270 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Nov 02 13:54:22.428240 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.428218 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:54:22.428390 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.428354 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:54:22.788521 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.788489 5081 generic.go:356] "Generic (PLEG): container finished" podID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerID="aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3" exitCode=0 Nov 02 13:54:22.788745 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.788579 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" event={"ID":"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03","Type":"ContainerDied","Data":"aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3"} Nov 02 13:54:22.789062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.789033 5081 scope.go:122] "RemoveContainer" containerID="aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3" Nov 02 13:54:22.790503 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.790473 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:22.790627 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.790591 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:22.790694 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:22.790644 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:54:23.179212 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:23.179178 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:54:23.180482 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:23.180461 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 13:54:23.429838 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:23.429763 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:54:23.430771 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:23.430752 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 13:54:23.436677 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:23.436616 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:54:23.796722 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:23.796641 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" event={"ID":"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03","Type":"ContainerStarted","Data":"559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42"} Nov 02 13:54:24.790443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:24.790411 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:54:24.791675 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:24.791653 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 02 13:54:24.791748 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:24.791701 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 02 13:54:25.791251 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:25.791215 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 02 13:54:25.791683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:25.791271 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 02 13:54:26.790468 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:26.790435 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 02 13:54:26.790671 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:26.790485 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 02 13:54:27.790509 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:27.790474 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 02 13:54:27.790934 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:27.790527 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 02 13:54:28.790830 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:28.790795 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Nov 02 13:54:28.791266 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:28.790863 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Nov 02 13:54:29.795229 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:29.795194 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:54:29.795666 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:29.795457 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:54:29.796162 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:29.796143 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 13:54:31.754553 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:31.754494 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:54:33.245261 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.245232 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf"] Nov 02 13:54:33.248793 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.248772 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.258293 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.258273 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"openshift-service-ca.crt\"" Nov 02 13:54:33.258654 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.258637 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"kube-root-ca.crt\"" Nov 02 13:54:33.258773 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.258756 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"simulator-w1-f2e945-kserve-self-signed-certs\"" Nov 02 13:54:33.259703 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.259683 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-f2e945\"/\"default-dockercfg-ffm7d\"" Nov 02 13:54:33.263368 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.263341 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf"] Nov 02 13:54:33.352703 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.352666 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqkh\" (UniqueName: \"kubernetes.io/projected/9499de8a-c0b1-49ea-9c99-c16b1d27e789-kube-api-access-szqkh\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.352878 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.352741 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-home\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.352878 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.352787 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tmp-dir\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.352969 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.352881 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tls-certs\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.353004 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.352981 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-model-cache\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.353052 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.353007 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-dshm\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.453829 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.453797 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-model-cache\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454031 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.453848 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-dshm\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454031 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.453936 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqkh\" (UniqueName: \"kubernetes.io/projected/9499de8a-c0b1-49ea-9c99-c16b1d27e789-kube-api-access-szqkh\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454031 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.453996 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-home\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454031 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.454016 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tmp-dir\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454254 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.454045 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tls-certs\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454306 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.454264 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-model-cache\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454393 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.454371 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tmp-dir\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.454450 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.454395 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-home\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.456336 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.456308 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-dshm\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.456713 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.456695 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tls-certs\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.468323 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.468301 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqkh\" (UniqueName: \"kubernetes.io/projected/9499de8a-c0b1-49ea-9c99-c16b1d27e789-kube-api-access-szqkh\") pod \"simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.559861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.559774 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:33.841585 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.841561 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf"] Nov 02 13:54:33.844063 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:54:33.844034 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9499de8a_c0b1_49ea_9c99_c16b1d27e789.slice/crio-5e54d19106c603df01180b0845c9cb30f5fc084969425096a40ad48ce409e87b WatchSource:0}: Error finding container 5e54d19106c603df01180b0845c9cb30f5fc084969425096a40ad48ce409e87b: Status 404 returned error can't find the container with id 5e54d19106c603df01180b0845c9cb30f5fc084969425096a40ad48ce409e87b Nov 02 13:54:33.862018 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:33.861989 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" event={"ID":"9499de8a-c0b1-49ea-9c99-c16b1d27e789","Type":"ContainerStarted","Data":"5e54d19106c603df01180b0845c9cb30f5fc084969425096a40ad48ce409e87b"} Nov 02 13:54:34.869269 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:34.869237 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" event={"ID":"9499de8a-c0b1-49ea-9c99-c16b1d27e789","Type":"ContainerStarted","Data":"d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed"} Nov 02 13:54:34.891932 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:34.891877 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" podStartSLOduration=1.891863686 podStartE2EDuration="1.891863686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:54:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:54:34.889726517 +0000 UTC m=+692.882114800" watchObservedRunningTime="2026-11-02 13:54:34.891863686 +0000 UTC m=+692.884251970" Nov 02 13:54:35.560674 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:35.560645 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:38.556026 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:54:38.555990 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:54:43.560000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:43.559964 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:43.573174 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:43.573147 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:43.935525 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:43.935495 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:54:44.344711 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:44.344629 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:54:58.436264 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:54:58.436229 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:55:08.556470 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:55:08.556423 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:55:20.144429 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.144398 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7"] Nov 02 13:55:20.148638 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.148621 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.157910 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.157890 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-9e0c2f-openshift-default-dockercfg-xxct7\"" Nov 02 13:55:20.166895 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.166864 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7"] Nov 02 13:55:20.180164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180130 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180199 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180293 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180319 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180429 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180480 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr26w\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-kube-api-access-nr26w\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180649 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180514 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180649 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180617 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.180757 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.180667 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.281960 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.281923 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.281960 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.281965 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282179 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282002 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282179 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282025 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282255 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282178 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282255 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282228 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr26w\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-kube-api-access-nr26w\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282396 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282370 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282484 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282418 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282484 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282381 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282484 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282448 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282484 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282456 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282693 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282486 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282807 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282781 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.282946 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.282922 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.284808 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.284788 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.285040 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.285024 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.294474 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.294453 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr26w\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-kube-api-access-nr26w\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.297733 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.297711 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.362774 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.362747 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:55:20.462390 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.462354 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:20.597210 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.597177 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h"] Nov 02 13:55:20.601500 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.601479 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.616409 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.616376 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-4fc49b-openshift-default-dockercfg-mnqnf\"" Nov 02 13:55:20.622587 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.622519 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h"] Nov 02 13:55:20.698269 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.698224 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.698693 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.698667 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.698890 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.698874 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.700731 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.700707 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.700928 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.700913 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.701075 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.701061 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76h9r\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-kube-api-access-76h9r\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.701258 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.701243 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.701395 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.701381 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.701618 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.701598 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.754730 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.754705 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7"] Nov 02 13:55:20.755933 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:55:20.755902 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d59e7b_7d97_4e82_9c10_6d48ea48d3f5.slice/crio-b59a0b2e45acf245bbd55df76f952b15ac18ea54325715a1fa0ad5731f1dcaea WatchSource:0}: Error finding container b59a0b2e45acf245bbd55df76f952b15ac18ea54325715a1fa0ad5731f1dcaea: Status 404 returned error can't find the container with id b59a0b2e45acf245bbd55df76f952b15ac18ea54325715a1fa0ad5731f1dcaea Nov 02 13:55:20.758441 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.758406 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:20.758521 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.758472 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:20.758521 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.758510 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:20.803342 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.803294 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.803482 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.803343 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76h9r\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-kube-api-access-76h9r\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.803482 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.803415 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.803482 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.803439 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.803648 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.803490 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.803648 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.803599 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.803944 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.803919 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.804118 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.804098 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.804196 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.804176 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.804268 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.804250 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.804334 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.804295 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.804391 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.804361 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.804502 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.804480 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.804600 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.804513 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.806528 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.806499 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.807216 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.807192 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.818419 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.818394 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76h9r\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-kube-api-access-76h9r\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.823812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.823785 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4"] Nov 02 13:55:20.825386 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.825367 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:20.829599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.829006 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.846676 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.846514 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-f2e945-openshift-default-dockercfg-d2ckm\"" Nov 02 13:55:20.846893 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.846870 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4"] Nov 02 13:55:20.905063 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905032 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905254 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905074 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905254 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905113 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d388d07c-c4e2-4479-8a89-89408647220f-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905364 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905290 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8zxq\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-kube-api-access-h8zxq\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905364 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905333 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905434 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905461 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d388d07c-c4e2-4479-8a89-89408647220f-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905589 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905494 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.905642 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.905609 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:20.915373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:20.915345 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007619 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007695 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007761 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d388d07c-c4e2-4479-8a89-89408647220f-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007808 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8zxq\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-kube-api-access-h8zxq\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007837 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007896 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007923 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d388d07c-c4e2-4479-8a89-89408647220f-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007958 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.007999 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.008770 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.009098 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.009386 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.009498 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.009809 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d388d07c-c4e2-4479-8a89-89408647220f-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.011942 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.011753 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.013441 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.013418 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d388d07c-c4e2-4479-8a89-89408647220f-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.052269 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.051074 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.061381 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.061318 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8zxq\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-kube-api-access-h8zxq\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.144076 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.143793 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:21.228887 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.228848 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" event={"ID":"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5","Type":"ContainerStarted","Data":"c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f"} Nov 02 13:55:21.231027 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.230965 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" event={"ID":"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5","Type":"ContainerStarted","Data":"b59a0b2e45acf245bbd55df76f952b15ac18ea54325715a1fa0ad5731f1dcaea"} Nov 02 13:55:21.234165 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.233569 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h"] Nov 02 13:55:21.246493 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:55:21.246452 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9a70f0_14fd_499d_8c22_3c759273ca0d.slice/crio-6bc1bc250bbd1a2d38264e97f45ea3e3f9682ee5206fa2eeb21995e05a66327d WatchSource:0}: Error finding container 6bc1bc250bbd1a2d38264e97f45ea3e3f9682ee5206fa2eeb21995e05a66327d: Status 404 returned error can't find the container with id 6bc1bc250bbd1a2d38264e97f45ea3e3f9682ee5206fa2eeb21995e05a66327d Nov 02 13:55:21.306601 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.285129 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podStartSLOduration=1.285109447 podStartE2EDuration="1.285109447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:55:21.266613008 +0000 UTC m=+739.259001293" watchObservedRunningTime="2026-11-02 13:55:21.285109447 +0000 UTC m=+739.277497733" Nov 02 13:55:21.318405 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.317577 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:21.318405 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.317673 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:21.318405 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.317720 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:21.468208 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.464166 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:21.468208 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.464313 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 02 13:55:21.468208 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.464350 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 02 13:55:21.736595 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.735625 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:21.736595 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.735733 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:21.736595 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.735784 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:21.799565 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:21.798362 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4"] Nov 02 13:55:22.268622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.268312 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" event={"ID":"d388d07c-c4e2-4479-8a89-89408647220f","Type":"ContainerStarted","Data":"e5e20d8c3afb8d7142deaeccfec830b3707260a466ba136ae6456015c159a2db"} Nov 02 13:55:22.268622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.268384 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" event={"ID":"d388d07c-c4e2-4479-8a89-89408647220f","Type":"ContainerStarted","Data":"e5b4245eb6d1ed0b3932b0dbe0d3633611d1647638dedc33d15e2d526c1ced73"} Nov 02 13:55:22.276561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.276048 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" event={"ID":"9d9a70f0-14fd-499d-8c22-3c759273ca0d","Type":"ContainerStarted","Data":"09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63"} Nov 02 13:55:22.276561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.276105 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" event={"ID":"9d9a70f0-14fd-499d-8c22-3c759273ca0d","Type":"ContainerStarted","Data":"6bc1bc250bbd1a2d38264e97f45ea3e3f9682ee5206fa2eeb21995e05a66327d"} Nov 02 13:55:22.390957 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.384370 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podStartSLOduration=2.38434846 podStartE2EDuration="2.38434846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:55:22.350851597 +0000 UTC m=+740.343239906" watchObservedRunningTime="2026-11-02 13:55:22.38434846 +0000 UTC m=+740.376736746" Nov 02 13:55:22.464421 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.463659 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 02 13:55:22.464421 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.463765 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 02 13:55:22.915734 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.915698 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:22.917056 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.917027 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 02 13:55:22.917167 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:22.917072 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 02 13:55:23.157976 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:23.157944 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:23.181777 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:23.181679 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 02 13:55:23.182030 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:23.182001 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 02 13:55:23.470620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:23.463963 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 02 13:55:23.470620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:23.464028 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 02 13:55:23.915987 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:23.915948 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 02 13:55:23.916197 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:23.916013 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 02 13:55:24.157562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:24.155121 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 02 13:55:24.157562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:24.155187 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 02 13:55:24.468562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:24.467727 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 02 13:55:24.468562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:24.467792 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 02 13:55:24.915959 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:24.915923 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 02 13:55:24.916581 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:24.916552 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 02 13:55:25.146185 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:25.146134 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 02 13:55:25.146994 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:25.146949 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 02 13:55:25.463024 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:25.462983 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 02 13:55:25.463279 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:25.463252 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 02 13:55:25.916127 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:25.916094 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 02 13:55:25.916744 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:25.916708 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 02 13:55:26.156693 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:26.156657 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 02 13:55:26.156983 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:26.156954 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 02 13:55:26.465077 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:26.465042 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 02 13:55:26.465353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:26.465324 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 02 13:55:26.916592 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:26.916520 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 02 13:55:26.917082 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:26.916608 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 02 13:55:27.154562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:27.148077 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 02 13:55:27.154562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:27.148137 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 02 13:55:27.466997 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:27.466963 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Nov 02 13:55:27.467284 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:27.467255 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Nov 02 13:55:27.916250 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:27.916215 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Nov 02 13:55:27.916418 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:27.916281 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Nov 02 13:55:28.155562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.152654 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Nov 02 13:55:28.155562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.152718 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Nov 02 13:55:28.468993 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.468961 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:28.469392 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.469366 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:28.470330 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.470308 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 13:55:28.496299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.496249 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podStartSLOduration=8.496235001 podStartE2EDuration="8.496235001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:55:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:55:22.390923937 +0000 UTC m=+740.383312238" watchObservedRunningTime="2026-11-02 13:55:28.496235001 +0000 UTC m=+746.488623284" Nov 02 13:55:28.928829 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.928795 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:28.929969 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.929939 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:28.930814 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:28.930772 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 13:55:29.150760 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:29.150732 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:29.151037 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:29.151011 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:29.151985 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:29.151964 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 13:55:35.446861 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.446824 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz"] Nov 02 13:55:35.452104 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.452075 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.463699 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.463669 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz"] Nov 02 13:55:35.487214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.487172 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-1eb567-openshift-default-dockercfg-lpvp4\"" Nov 02 13:55:35.549643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.549611 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.549818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.549649 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.549818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.549668 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.549818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.549690 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwd7l\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-kube-api-access-fwd7l\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.549919 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.549872 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86eda318-c68d-4735-9664-92a444391b24-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.549986 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.549964 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.550018 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.549994 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.550060 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.550018 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.550096 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.550068 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86eda318-c68d-4735-9664-92a444391b24-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.651562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651507 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.651751 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651571 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86eda318-c68d-4735-9664-92a444391b24-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.651751 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651659 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.651751 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651688 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.651751 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651705 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.651751 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651734 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd7l\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-kube-api-access-fwd7l\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651846 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86eda318-c68d-4735-9664-92a444391b24-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651941 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.651966 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652153 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.652017 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652153 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.652069 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.652323 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86eda318-c68d-4735-9664-92a444391b24-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652515 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.652486 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.652683 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.652626 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.654507 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.654482 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.654643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.654626 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86eda318-c68d-4735-9664-92a444391b24-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.665886 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.665865 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.666067 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.666049 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwd7l\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-kube-api-access-fwd7l\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:35.767295 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:35.767209 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:36.072356 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.072329 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz"] Nov 02 13:55:36.073752 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:55:36.073725 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86eda318_c68d_4735_9664_92a444391b24.slice/crio-f3d235d846a5987220680f389889c911bc969aa7b636fa8dd28a21d62522ecd3 WatchSource:0}: Error finding container f3d235d846a5987220680f389889c911bc969aa7b636fa8dd28a21d62522ecd3: Status 404 returned error can't find the container with id f3d235d846a5987220680f389889c911bc969aa7b636fa8dd28a21d62522ecd3 Nov 02 13:55:36.076341 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.076303 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:36.076460 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.076384 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:36.076460 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.076428 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:55:36.399245 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.399153 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" event={"ID":"86eda318-c68d-4735-9664-92a444391b24","Type":"ContainerStarted","Data":"4906557d7d67f9e32d82b7738b148994383d3460f37a065e3f5f8dbbdfc11f2e"} Nov 02 13:55:36.399438 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.399249 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" event={"ID":"86eda318-c68d-4735-9664-92a444391b24","Type":"ContainerStarted","Data":"f3d235d846a5987220680f389889c911bc969aa7b636fa8dd28a21d62522ecd3"} Nov 02 13:55:36.427441 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.427390 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podStartSLOduration=1.427374645 podStartE2EDuration="1.427374645s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:55:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:55:36.423921925 +0000 UTC m=+754.416310212" watchObservedRunningTime="2026-11-02 13:55:36.427374645 +0000 UTC m=+754.419762929" Nov 02 13:55:36.767975 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:36.767936 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:37.769731 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:37.769690 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 02 13:55:37.770145 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:37.769752 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 02 13:55:38.597167 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:55:38.597125 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:55:38.771002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:38.770954 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 02 13:55:38.771521 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:38.771018 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 02 13:55:39.768176 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:39.768140 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 02 13:55:39.768395 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:39.768201 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 02 13:55:40.768017 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:40.767982 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 02 13:55:40.768431 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:40.768036 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 02 13:55:41.768317 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:41.768283 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Nov 02 13:55:41.768780 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:41.768337 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Nov 02 13:55:43.594422 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:43.594366 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:43.594921 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:43.594904 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:43.595946 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:43.595926 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 13:55:45.865860 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:55:45.865829 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:56:08.557004 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:56:08.556965 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:56:20.251076 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.251041 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq"] Nov 02 13:56:20.256411 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.256387 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.282070 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.282043 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq"] Nov 02 13:56:20.342342 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342307 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.342502 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342436 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.342502 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342489 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.342602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342520 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.342602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342582 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.342671 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342620 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.342728 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342709 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.342988 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.342965 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwb6k\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-kube-api-access-jwb6k\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.343101 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.343068 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444331 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444379 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444436 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444470 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444496 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444551 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444586 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444675 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.444989 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.444725 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwb6k\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-kube-api-access-jwb6k\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.445047 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.445013 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.445104 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.445060 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.445199 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.445176 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.445256 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.445212 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.445319 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.445293 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.446929 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.446906 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.447186 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.447170 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.459463 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.459440 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwb6k\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-kube-api-access-jwb6k\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.459627 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.459600 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.572243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.572169 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:20.859743 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.859718 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq"] Nov 02 13:56:20.861527 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:56:20.861497 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf1d379_625a_4bdb_881d_cf1e8bf48bfd.slice/crio-610719738bd22f3920a01d976d0beeec50f66de662aca397491b7e079e83cb7e WatchSource:0}: Error finding container 610719738bd22f3920a01d976d0beeec50f66de662aca397491b7e079e83cb7e: Status 404 returned error can't find the container with id 610719738bd22f3920a01d976d0beeec50f66de662aca397491b7e079e83cb7e Nov 02 13:56:20.863921 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.863889 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:20.863993 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.863953 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:20.863993 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:20.863981 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:21.766031 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:21.765988 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" event={"ID":"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd","Type":"ContainerStarted","Data":"f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc"} Nov 02 13:56:21.766498 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:21.766041 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" event={"ID":"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd","Type":"ContainerStarted","Data":"610719738bd22f3920a01d976d0beeec50f66de662aca397491b7e079e83cb7e"} Nov 02 13:56:21.807298 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:21.807251 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" podStartSLOduration=1.807235272 podStartE2EDuration="1.807235272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:21.805693622 +0000 UTC m=+799.798081952" watchObservedRunningTime="2026-11-02 13:56:21.807235272 +0000 UTC m=+799.799623556" Nov 02 13:56:22.573344 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:22.573310 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:22.574574 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:22.574516 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 02 13:56:22.574730 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:22.574585 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 02 13:56:23.573139 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:23.573104 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 02 13:56:23.573582 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:23.573159 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 02 13:56:24.572597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:24.572564 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 02 13:56:24.572819 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:24.572778 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 02 13:56:25.573599 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:25.573563 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 02 13:56:25.574016 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:25.573634 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 02 13:56:26.572495 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:26.572462 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Nov 02 13:56:26.572699 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:26.572526 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Nov 02 13:56:27.577003 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:27.576971 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:27.577487 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:27.577417 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:27.578123 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:27.578103 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 13:56:30.924130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:30.924098 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:56:32.795655 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:32.795614 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr"] Nov 02 13:56:32.901588 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:32.887901 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.031564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.030586 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr"] Nov 02 13:56:33.083407 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.083292 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.083725 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.083700 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.083888 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.083871 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.084074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.084049 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.337616 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.084184 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnhw\" (UniqueName: \"kubernetes.io/projected/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-kube-api-access-7qnhw\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.337616 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.336949 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.337616 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.336989 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.337616 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.337141 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.337616 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.337224 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.470562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.446405 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.470562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.446462 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.470562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.446590 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.470989 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.471114 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.471195 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.471221 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.471279 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.471307 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnhw\" (UniqueName: \"kubernetes.io/projected/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-kube-api-access-7qnhw\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.472331 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-credential-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.473047 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.520968 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnhw\" (UniqueName: \"kubernetes.io/projected/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-kube-api-access-7qnhw\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.522078 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.522370 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-workload-socket\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.523169 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-workload-certs\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.530562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.523994 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-data\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.645818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.643917 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-envoy\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.732560 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.732475 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9a681d7-5f8e-43bb-9506-5fe18c312e7c-istio-token\") pod \"maas-default-gateway-openshift-default-8b64f9ff9-rcdvr\" (UID: \"e9a681d7-5f8e-43bb-9506-5fe18c312e7c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:33.851135 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:33.851098 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:34.164658 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:34.163434 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr"] Nov 02 13:56:34.168725 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:34.168682 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:34.168839 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:34.168768 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:34.168912 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:34.168876 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:35.131502 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.131471 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" event={"ID":"e9a681d7-5f8e-43bb-9506-5fe18c312e7c","Type":"ContainerStarted","Data":"5763f35545e9d7d201de6ec8f99b8720caa3823c2844ea21bea206a783f3119f"} Nov 02 13:56:35.132003 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.131515 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" event={"ID":"e9a681d7-5f8e-43bb-9506-5fe18c312e7c","Type":"ContainerStarted","Data":"1a9082262f899c94da1f1b637e41927bc99f2301dd0ed0ef79982723bc31c2d5"} Nov 02 13:56:35.207633 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.207584 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podStartSLOduration=3.207567698 podStartE2EDuration="3.207567698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:35.200015967 +0000 UTC m=+813.192404285" watchObservedRunningTime="2026-11-02 13:56:35.207567698 +0000 UTC m=+813.199955979" Nov 02 13:56:35.560583 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.560527 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f"] Nov 02 13:56:35.581214 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.581189 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.598551 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.598504 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f"] Nov 02 13:56:35.680467 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.680430 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.680677 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.680493 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.680677 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.680524 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.680786 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.680698 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.680786 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.680741 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.680902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.680885 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.681052 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.681029 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9w69\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-kube-api-access-m9w69\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.681132 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.681077 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b57ce4-647b-4e78-ba2b-67853d9d905a-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.681132 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.681115 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.781908 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.781872 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782100 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.781956 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9w69\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-kube-api-access-m9w69\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782100 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.781984 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b57ce4-647b-4e78-ba2b-67853d9d905a-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782100 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782013 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782100 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782080 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782115 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782139 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782198 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782325 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782225 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782651 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782332 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782651 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782418 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782651 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782515 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782651 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782643 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.782817 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.782739 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b57ce4-647b-4e78-ba2b-67853d9d905a-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.784762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.784739 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.784972 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.784955 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.796583 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.796554 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.796799 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.796783 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9w69\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-kube-api-access-m9w69\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:35.853422 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.853274 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:35.854062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.853739 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 02 13:56:35.854062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.853794 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 02 13:56:35.905158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:35.905125 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:36.009450 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.007606 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz"] Nov 02 13:56:36.016751 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.014038 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.049562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.047150 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz"] Nov 02 13:56:36.086451 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086313 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff686aee-f0df-446f-9d55-bda087ab3c55-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086787 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086472 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086787 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086635 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086787 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086701 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086787 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086735 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9frp7\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-kube-api-access-9frp7\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086955 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086790 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086955 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086821 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086955 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086859 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.086955 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.086909 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.187662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.187625 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.187662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.187661 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.187711 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.187771 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.187858 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff686aee-f0df-446f-9d55-bda087ab3c55-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.187969 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188054 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188078 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188152 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188180 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188211 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9frp7\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-kube-api-access-9frp7\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188783 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188579 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188783 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188690 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff686aee-f0df-446f-9d55-bda087ab3c55-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.188783 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.188699 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.190887 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.190863 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.191023 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.191002 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.205268 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.205234 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9frp7\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-kube-api-access-9frp7\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.206139 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.206115 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.232334 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.232303 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f"] Nov 02 13:56:36.247571 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:56:36.246732 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b57ce4_647b_4e78_ba2b_67853d9d905a.slice/crio-925cb56b71c2b3274515f626cd452f529788b936f136890c006f164d22f54d6a WatchSource:0}: Error finding container 925cb56b71c2b3274515f626cd452f529788b936f136890c006f164d22f54d6a: Status 404 returned error can't find the container with id 925cb56b71c2b3274515f626cd452f529788b936f136890c006f164d22f54d6a Nov 02 13:56:36.264840 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.262783 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:36.264840 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.262857 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:36.264840 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.262893 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:36.330898 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.330869 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:36.663620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.659026 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz"] Nov 02 13:56:36.677844 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:56:36.677813 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff686aee_f0df_446f_9d55_bda087ab3c55.slice/crio-b16b50ee294086315d1b82816c61e7612758a5780a9e1ff0966088d954546985 WatchSource:0}: Error finding container b16b50ee294086315d1b82816c61e7612758a5780a9e1ff0966088d954546985: Status 404 returned error can't find the container with id b16b50ee294086315d1b82816c61e7612758a5780a9e1ff0966088d954546985 Nov 02 13:56:36.680669 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.680632 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:36.680776 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.680719 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:36.680776 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.680769 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:36.857992 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.857949 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 02 13:56:36.858197 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:36.858017 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 02 13:56:37.173489 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.173448 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" event={"ID":"ff686aee-f0df-446f-9d55-bda087ab3c55","Type":"ContainerStarted","Data":"43c94e81f8bdc365b36b8d80936f39f82dec56d18dcc1b8d8cfb0094820a07ba"} Nov 02 13:56:37.173704 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.173525 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" event={"ID":"ff686aee-f0df-446f-9d55-bda087ab3c55","Type":"ContainerStarted","Data":"b16b50ee294086315d1b82816c61e7612758a5780a9e1ff0966088d954546985"} Nov 02 13:56:37.175145 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.175118 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" event={"ID":"49b57ce4-647b-4e78-ba2b-67853d9d905a","Type":"ContainerStarted","Data":"75edea22dd2ad32db3f853f4a6a39fb23628c8db404e9da4b23bda3aa41708d7"} Nov 02 13:56:37.175266 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.175174 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" event={"ID":"49b57ce4-647b-4e78-ba2b-67853d9d905a","Type":"ContainerStarted","Data":"925cb56b71c2b3274515f626cd452f529788b936f136890c006f164d22f54d6a"} Nov 02 13:56:37.203358 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.203293 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podStartSLOduration=2.203273171 podStartE2EDuration="2.203273171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:37.197615498 +0000 UTC m=+815.190003794" watchObservedRunningTime="2026-11-02 13:56:37.203273171 +0000 UTC m=+815.195661459" Nov 02 13:56:37.234412 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.234347 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podStartSLOduration=2.2343304760000002 podStartE2EDuration="2.234330476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:37.234317295 +0000 UTC m=+815.226705593" watchObservedRunningTime="2026-11-02 13:56:37.234330476 +0000 UTC m=+815.226718764" Nov 02 13:56:37.331850 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.331807 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:37.333516 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.333493 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 02 13:56:37.333618 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.333592 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 02 13:56:37.855562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.854957 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 02 13:56:37.855562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.855029 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 02 13:56:37.916415 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.914298 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:37.916415 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.915915 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Nov 02 13:56:37.916415 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:37.915985 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Nov 02 13:56:38.332119 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:38.332061 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 02 13:56:38.332735 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:38.332131 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 02 13:56:38.626034 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:56:38.625948 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:56:38.853568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:38.851942 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 02 13:56:38.853568 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:38.852000 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 02 13:56:38.908567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:38.905934 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Nov 02 13:56:38.908567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:38.905996 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Nov 02 13:56:39.331725 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:39.331632 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 02 13:56:39.331725 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:39.331714 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 02 13:56:39.851995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:39.851957 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 02 13:56:39.852597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:39.852564 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 02 13:56:39.906997 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:39.906957 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Nov 02 13:56:39.907300 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:39.907267 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Nov 02 13:56:40.331688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:40.331647 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 02 13:56:40.331939 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:40.331912 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 02 13:56:40.853407 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:40.852934 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 02 13:56:40.853407 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:40.852999 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 02 13:56:40.915416 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:40.914967 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Nov 02 13:56:40.915416 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:40.915030 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Nov 02 13:56:41.331661 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:41.331631 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 02 13:56:41.331851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:41.331688 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 02 13:56:41.857561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:41.857035 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Nov 02 13:56:41.857561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:41.857093 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Nov 02 13:56:41.906285 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:41.906251 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Nov 02 13:56:41.906488 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:41.906315 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Nov 02 13:56:42.331758 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:42.331730 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 02 13:56:42.331997 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:42.331975 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 02 13:56:42.906435 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:42.906388 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Nov 02 13:56:42.906878 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:42.906481 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Nov 02 13:56:43.331632 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.331487 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body= Nov 02 13:56:43.331632 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.331579 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" Nov 02 13:56:43.841435 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.841393 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:43.842651 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.842621 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:43.843795 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.843774 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" Nov 02 13:56:43.913874 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.913844 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:43.915808 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.915786 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:43.927700 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:43.927666 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 13:56:44.336635 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:44.336608 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:44.337090 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:44.337074 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:44.338015 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:44.337996 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 13:56:50.525164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.525123 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9"] Nov 02 13:56:50.532584 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.532560 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9"] Nov 02 13:56:50.532716 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.532633 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.618902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.618860 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.618902 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.618913 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.619135 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.619052 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bfddcb-5159-478f-9763-e04eca085914-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.619135 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.619081 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntdtm\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-kube-api-access-ntdtm\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.619278 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.619151 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.619278 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.619192 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bfddcb-5159-478f-9763-e04eca085914-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.619377 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.619314 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.619436 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.619391 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.619511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.619493 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720400 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720362 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720400 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720403 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720462 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bfddcb-5159-478f-9763-e04eca085914-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720485 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntdtm\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-kube-api-access-ntdtm\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720513 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720582 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bfddcb-5159-478f-9763-e04eca085914-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720655 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720923 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720715 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720923 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720790 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.720923 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.720833 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.721224 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.721180 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.721299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.721226 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.721525 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.721504 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.721625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.721606 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bfddcb-5159-478f-9763-e04eca085914-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.723114 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.723083 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.723274 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.723258 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bfddcb-5159-478f-9763-e04eca085914-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.739937 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.739913 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.740893 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.740873 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntdtm\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-kube-api-access-ntdtm\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.849681 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.849599 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:50.850078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.850053 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm"] Nov 02 13:56:50.854301 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.854278 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.877924 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.877855 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm"] Nov 02 13:56:50.924171 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924138 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924345 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924232 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924345 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924295 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924526 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924506 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924574 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924597 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924643 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924616 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924668 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qjzw\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-kube-api-access-9qjzw\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:50.924797 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:50.924690 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026001 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.025964 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qjzw\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-kube-api-access-9qjzw\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026001 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026003 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026062 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026085 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026119 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026231 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026253 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026280 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.026299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026297 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.027057 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.026988 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.027057 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.027040 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.027654 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.027522 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.027654 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.027598 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.029768 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.029748 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.029919 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.029896 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.031164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.031087 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.040681 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.040654 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.041329 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.041306 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qjzw\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-kube-api-access-9qjzw\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.164167 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.164137 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9"] Nov 02 13:56:51.165020 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:56:51.164989 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bfddcb_5159_478f_9763_e04eca085914.slice/crio-0270f2fc95fc2f70319b427b1f9d1c4a6cab402e0fafbaa9177d63ff79f27b67 WatchSource:0}: Error finding container 0270f2fc95fc2f70319b427b1f9d1c4a6cab402e0fafbaa9177d63ff79f27b67: Status 404 returned error can't find the container with id 0270f2fc95fc2f70319b427b1f9d1c4a6cab402e0fafbaa9177d63ff79f27b67 Nov 02 13:56:51.167661 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.167625 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:51.167776 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.167717 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:51.167776 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.167765 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:51.169782 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.169765 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:51.461967 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.461942 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm"] Nov 02 13:56:51.462839 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:56:51.462816 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271043d1_af63_44b3_a36a_5d8f3f3c6c5d.slice/crio-da179309db3beb2332f8520d127019077acfc74ed5619c6534a29e63203ba2e1 WatchSource:0}: Error finding container da179309db3beb2332f8520d127019077acfc74ed5619c6534a29e63203ba2e1: Status 404 returned error can't find the container with id da179309db3beb2332f8520d127019077acfc74ed5619c6534a29e63203ba2e1 Nov 02 13:56:51.465435 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.465402 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:51.465511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.465468 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:51.465511 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.465497 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:56:51.541251 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.541218 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" event={"ID":"271043d1-af63-44b3-a36a-5d8f3f3c6c5d","Type":"ContainerStarted","Data":"da179309db3beb2332f8520d127019077acfc74ed5619c6534a29e63203ba2e1"} Nov 02 13:56:51.543222 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.543191 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" event={"ID":"30bfddcb-5159-478f-9763-e04eca085914","Type":"ContainerStarted","Data":"e7a5cec16d5c4f79702113ca37b5d8a0426e9de0c477688cbfa3b197cdb20d9c"} Nov 02 13:56:51.543366 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.543236 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" event={"ID":"30bfddcb-5159-478f-9763-e04eca085914","Type":"ContainerStarted","Data":"0270f2fc95fc2f70319b427b1f9d1c4a6cab402e0fafbaa9177d63ff79f27b67"} Nov 02 13:56:51.571781 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.571715 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podStartSLOduration=1.571693987 podStartE2EDuration="1.571693987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:51.567085196 +0000 UTC m=+829.559473510" watchObservedRunningTime="2026-11-02 13:56:51.571693987 +0000 UTC m=+829.564082272" Nov 02 13:56:51.858619 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:51.855637 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:52.589613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:52.589575 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" event={"ID":"271043d1-af63-44b3-a36a-5d8f3f3c6c5d","Type":"ContainerStarted","Data":"3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7"} Nov 02 13:56:52.615250 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:52.615204 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podStartSLOduration=2.615189408 podStartE2EDuration="2.615189408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:56:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:56:52.613328519 +0000 UTC m=+830.605716803" watchObservedRunningTime="2026-11-02 13:56:52.615189408 +0000 UTC m=+830.607577691" Nov 02 13:56:52.865625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:52.862490 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 02 13:56:52.865625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:52.862589 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 02 13:56:53.171934 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:53.171902 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:53.175695 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:53.175652 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Nov 02 13:56:53.175952 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:53.175916 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Nov 02 13:56:53.857813 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:53.857779 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 02 13:56:53.858404 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:53.858370 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 02 13:56:54.190562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:54.189687 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Nov 02 13:56:54.190562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:54.189765 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Nov 02 13:56:54.870030 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:54.869991 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 02 13:56:54.870674 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:54.870641 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 02 13:56:55.186016 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:55.185979 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Nov 02 13:56:55.186333 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:55.186305 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Nov 02 13:56:55.860561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:55.854112 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 02 13:56:55.860561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:55.854174 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 02 13:56:56.181570 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:56.179695 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Nov 02 13:56:56.181570 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:56.179754 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Nov 02 13:56:56.855561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:56.852997 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 02 13:56:56.855561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:56.853060 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 02 13:56:57.177139 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:57.177103 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Nov 02 13:56:57.177421 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:57.177393 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Nov 02 13:56:57.852733 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:57.852685 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body= Nov 02 13:56:57.853259 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:57.852755 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" Nov 02 13:56:58.170738 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:58.170699 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body= Nov 02 13:56:58.170931 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:58.170771 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" Nov 02 13:56:58.856947 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:58.856921 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:58.857384 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:58.857363 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:58.858260 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:58.858239 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 13:56:59.174869 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:59.174837 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:59.175323 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:59.175309 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:56:59.176183 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:56:59.176163 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 13:57:01.044858 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:01.044829 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:57:05.452923 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.452894 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9"] Nov 02 13:57:05.459331 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.459307 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.470716 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.470688 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9"] Nov 02 13:57:05.588136 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588100 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588314 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588266 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588314 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588292 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588416 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588374 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588416 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588408 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588530 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588447 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad76a45-130a-489d-8d24-f6591444324b-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588604 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588568 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad76a45-130a-489d-8d24-f6591444324b-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588784 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588758 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh5sb\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-kube-api-access-rh5sb\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.588834 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.588819 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690040 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh5sb\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-kube-api-access-rh5sb\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690086 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690117 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690176 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690191 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690244 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690582 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690278 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690582 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690304 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad76a45-130a-489d-8d24-f6591444324b-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690582 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690354 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad76a45-130a-489d-8d24-f6591444324b-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690808 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690647 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690808 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690685 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690808 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690736 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.690935 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.690833 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.691108 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.691089 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad76a45-130a-489d-8d24-f6591444324b-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.693318 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.693274 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.693703 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.693678 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad76a45-130a-489d-8d24-f6591444324b-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.750725 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.750587 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh5sb\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-kube-api-access-rh5sb\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.765203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.765134 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:05.806344 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:05.806312 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:06.105496 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:06.105471 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9"] Nov 02 13:57:06.107551 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:57:06.107504 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad76a45_130a_489d_8d24_f6591444324b.slice/crio-116c7baf7e35f5f9ffcfa83445edec0db896271250494b3fbe2795fd13c53a17 WatchSource:0}: Error finding container 116c7baf7e35f5f9ffcfa83445edec0db896271250494b3fbe2795fd13c53a17: Status 404 returned error can't find the container with id 116c7baf7e35f5f9ffcfa83445edec0db896271250494b3fbe2795fd13c53a17 Nov 02 13:57:06.110187 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:06.110154 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:06.110274 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:06.110225 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:06.110274 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:06.110253 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:06.864826 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:06.864785 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" event={"ID":"4ad76a45-130a-489d-8d24-f6591444324b","Type":"ContainerStarted","Data":"ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca"} Nov 02 13:57:06.865286 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:06.864841 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" event={"ID":"4ad76a45-130a-489d-8d24-f6591444324b","Type":"ContainerStarted","Data":"116c7baf7e35f5f9ffcfa83445edec0db896271250494b3fbe2795fd13c53a17"} Nov 02 13:57:06.892169 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:06.892117 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" podStartSLOduration=1.89210234 podStartE2EDuration="1.89210234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:06.888422539 +0000 UTC m=+844.880810824" watchObservedRunningTime="2026-11-02 13:57:06.89210234 +0000 UTC m=+844.884490624" Nov 02 13:57:07.807373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:07.807340 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:07.808928 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:07.808903 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 02 13:57:07.809046 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:07.808952 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 02 13:57:08.601677 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:57:08.600632 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:57:08.807306 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:08.807270 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 02 13:57:08.807486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:08.807325 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 02 13:57:09.807492 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:09.807459 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 02 13:57:09.808039 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:09.807513 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 02 13:57:10.806846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:10.806808 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 02 13:57:10.807015 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:10.806891 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 02 13:57:11.806794 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:11.806765 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body= Nov 02 13:57:11.807203 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:11.806815 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" Nov 02 13:57:13.142316 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:13.142278 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:13.143076 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:13.143041 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:13.145268 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:13.145245 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 13:57:20.256191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.256159 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb"] Nov 02 13:57:20.261265 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.260936 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.270741 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.270712 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb"] Nov 02 13:57:20.314871 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.314837 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315036 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.314878 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76673f96-b245-4c84-af4e-8926e7a32211-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315036 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.314900 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.315137 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315198 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.315186 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lng94\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-kube-api-access-lng94\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315258 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.315241 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315295 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.315284 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.315339 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76673f96-b245-4c84-af4e-8926e7a32211-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.315392 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.315381 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417049 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417014 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76673f96-b245-4c84-af4e-8926e7a32211-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417049 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417052 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417256 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417095 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417256 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417113 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76673f96-b245-4c84-af4e-8926e7a32211-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417256 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417132 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417356 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417290 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417356 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417336 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lng94\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-kube-api-access-lng94\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417455 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417361 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417455 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417389 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417578 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417556 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417690 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417660 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417758 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417696 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417813 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417793 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.417950 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.417926 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76673f96-b245-4c84-af4e-8926e7a32211-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.419795 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.419767 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.419795 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.419789 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76673f96-b245-4c84-af4e-8926e7a32211-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.430837 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.430817 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.431035 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.431015 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lng94\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-kube-api-access-lng94\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.582859 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.582782 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:20.859629 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.859549 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w"] Nov 02 13:57:20.865985 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.865962 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.876030 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.875996 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w"] Nov 02 13:57:20.896003 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.895974 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb"] Nov 02 13:57:20.901709 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:57:20.901660 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76673f96_b245_4c84_af4e_8926e7a32211.slice/crio-b3d318e3c23dd25629a413f049cd4f3e009c5b7e9aeee2a0920e8979c56ee922 WatchSource:0}: Error finding container b3d318e3c23dd25629a413f049cd4f3e009c5b7e9aeee2a0920e8979c56ee922: Status 404 returned error can't find the container with id b3d318e3c23dd25629a413f049cd4f3e009c5b7e9aeee2a0920e8979c56ee922 Nov 02 13:57:20.903812 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.903775 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:20.903908 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.903853 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:20.903908 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.903901 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:20.927380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.926000 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.927380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.926071 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.927380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.926128 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.927380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.926161 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6d8abf-df1f-4eab-8022-8e881d76d904-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.927380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.926189 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.927380 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.926219 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.928976 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.928000 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdhlc\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-kube-api-access-pdhlc\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.928976 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.928284 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:20.928976 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:20.928481 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.002548 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.002497 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" event={"ID":"76673f96-b245-4c84-af4e-8926e7a32211","Type":"ContainerStarted","Data":"b3d318e3c23dd25629a413f049cd4f3e009c5b7e9aeee2a0920e8979c56ee922"} Nov 02 13:57:21.030074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030039 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030123 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030168 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030222 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030272 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030258 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6d8abf-df1f-4eab-8022-8e881d76d904-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030528 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030288 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030528 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030327 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030528 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030423 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdhlc\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-kube-api-access-pdhlc\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030528 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030454 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.030762 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030733 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.031014 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030815 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.031014 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030967 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.031158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.030994 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.031158 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.031107 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6d8abf-df1f-4eab-8022-8e881d76d904-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.033138 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.033118 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.033351 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.033331 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.043443 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.043395 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdhlc\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-kube-api-access-pdhlc\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.043596 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.043529 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.190180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.190151 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:21.480986 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.480957 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w"] Nov 02 13:57:21.481739 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:57:21.481712 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6d8abf_df1f_4eab_8022_8e881d76d904.slice/crio-7cc1e11b3a5659e0631a8b7e03441e71e01eb214cba1ae582516466432207a5a WatchSource:0}: Error finding container 7cc1e11b3a5659e0631a8b7e03441e71e01eb214cba1ae582516466432207a5a: Status 404 returned error can't find the container with id 7cc1e11b3a5659e0631a8b7e03441e71e01eb214cba1ae582516466432207a5a Nov 02 13:57:21.484503 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.484471 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:21.484641 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.484556 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:21.484641 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:21.484595 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:22.011865 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.011825 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" event={"ID":"bc6d8abf-df1f-4eab-8022-8e881d76d904","Type":"ContainerStarted","Data":"64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab"} Nov 02 13:57:22.012044 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.011894 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" event={"ID":"bc6d8abf-df1f-4eab-8022-8e881d76d904","Type":"ContainerStarted","Data":"7cc1e11b3a5659e0631a8b7e03441e71e01eb214cba1ae582516466432207a5a"} Nov 02 13:57:22.013694 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.013667 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" event={"ID":"76673f96-b245-4c84-af4e-8926e7a32211","Type":"ContainerStarted","Data":"fd53d43fd67ac9839d5d580529c20eeec7625358614b3fef57592cd240eae909"} Nov 02 13:57:22.061710 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.061647 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podStartSLOduration=2.061630377 podStartE2EDuration="2.061630377s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:22.059910776 +0000 UTC m=+860.052299078" watchObservedRunningTime="2026-11-02 13:57:22.061630377 +0000 UTC m=+860.054018661" Nov 02 13:57:22.090437 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.090376 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podStartSLOduration=2.090351389 podStartE2EDuration="2.090351389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:22.083700788 +0000 UTC m=+860.076089071" watchObservedRunningTime="2026-11-02 13:57:22.090351389 +0000 UTC m=+860.082739674" Nov 02 13:57:22.191206 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.191174 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:22.193097 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.193072 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:22.193210 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.193140 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:22.582987 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.582960 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:22.588023 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.587992 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:22.588207 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:22.588058 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:23.190849 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:23.190795 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:23.191032 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:23.190885 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:23.584634 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:23.584519 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:23.584634 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:23.584605 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:24.191131 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:24.191096 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:24.191341 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:24.191163 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:24.598601 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:24.598477 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:24.598601 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:24.598559 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:25.218564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:25.217019 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:25.218564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:25.217080 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:25.590619 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:25.590338 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:25.590619 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:25.590392 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:26.191048 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.191005 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:26.191647 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.191603 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:26.398299 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.398268 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr"] Nov 02 13:57:26.403974 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.403949 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.410696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.410669 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Nov 02 13:57:26.411858 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.411809 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Nov 02 13:57:26.411858 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.411846 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Nov 02 13:57:26.413191 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.413174 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kmsk4\"" Nov 02 13:57:26.417039 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.417020 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr"] Nov 02 13:57:26.505249 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.505154 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.505249 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.505191 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.505249 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.505224 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.505573 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.505254 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.505573 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.505269 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgxvk\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-kube-api-access-pgxvk\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.505573 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.505359 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.505573 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.505412 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.593561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.589995 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:26.593561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.590057 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.609821 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.609942 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.609970 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.609999 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.610051 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.610074 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxvk\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-kube-api-access-pgxvk\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.610229 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.616652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.614120 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.620838 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.620817 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.621199 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.621177 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.621679 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.621654 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.622164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.621872 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.634107 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.634077 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.651292 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.651182 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgxvk\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-kube-api-access-pgxvk\") pod \"istiod-openshift-gateway-7ddd9cfdc8-2wppr\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:26.723062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:26.722759 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:27.241037 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:27.240565 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:27.241037 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:27.240625 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:27.587763 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:27.587008 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:27.587763 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:27.587085 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:28.205562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:28.204806 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:28.205562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:28.205106 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:28.620039 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:28.602277 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:28.620039 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:28.602380 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:28.640571 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:28.639281 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr"] Nov 02 13:57:29.310564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.309090 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:29.310564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.309161 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:29.440789 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.440752 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" event={"ID":"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08","Type":"ContainerStarted","Data":"7a65928ac74a39f929f9db7dfbca7b9ab841c663e7a94b8a04237d64e7978669"} Nov 02 13:57:29.481392 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.481351 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:57:29.481696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.481665 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:57:29.597625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.595929 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body= Nov 02 13:57:29.597625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.595990 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" Nov 02 13:57:29.685578 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.672653 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:57:29.685578 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:29.672723 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:57:30.027687 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.026767 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:57:30.027687 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.026832 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:57:30.215576 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.214644 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:57:30.215576 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.214715 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:57:30.390476 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.307383 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body= Nov 02 13:57:30.503666 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.503616 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" Nov 02 13:57:30.586571 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.392840 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:57:30.634747 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:30.634704 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:57:31.140915 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:31.140881 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:31.142403 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:31.142379 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:31.143323 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:31.143302 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 13:57:32.233730 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:32.233688 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:57:32.234188 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:32.233752 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:57:32.856107 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:32.856070 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:32.856601 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:32.856572 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:32.857743 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:32.857721 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 13:57:33.265199 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:33.265164 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:33.265484 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:33.265232 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:33.606934 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:33.606843 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" event={"ID":"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08","Type":"ContainerStarted","Data":"ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a"} Nov 02 13:57:34.613388 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:34.613354 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:34.615070 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:34.615048 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 13:57:34.645126 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:34.645076 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" podStartSLOduration=4.002822042 podStartE2EDuration="8.645062483s" totalImagesPullingTime="4.642240441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:33.679418941 +0000 UTC m=+871.671807248" watchObservedRunningTime="2026-11-02 13:57:34.645062483 +0000 UTC m=+872.637450768" Nov 02 13:57:38.556868 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:57:38.556831 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:57:50.276369 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.276337 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:57:50.645818 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.645738 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w"] Nov 02 13:57:50.650932 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.650900 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660310 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660467 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660416 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660555 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660471 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jln2\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-kube-api-access-9jln2\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660555 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660511 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660689 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660596 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660747 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660710 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660747 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660738 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660839 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660824 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.660903 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.660888 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.675575 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.675521 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w"] Nov 02 13:57:50.761686 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.761652 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.761852 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.761741 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.761852 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.761805 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.761985 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.761853 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.761985 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.761920 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.761985 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.761952 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jln2\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-kube-api-access-9jln2\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.762106 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.761998 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.762106 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.762048 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.762173 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.762140 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.762652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.762621 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-credential-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.762851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.762797 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istiod-ca-cert\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.762851 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.762659 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-socket\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.762978 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.762881 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-data\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.763255 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.763234 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-certs\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.763833 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.763814 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r"] Nov 02 13:57:50.764483 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.764464 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-podinfo\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.765040 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.765024 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-envoy\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.768359 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.768340 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.796253 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.796214 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jln2\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-kube-api-access-9jln2\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.797137 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.797118 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-token\") pod \"e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.864353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864322 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8"] Nov 02 13:57:50.864601 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864452 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.864675 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864603 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.864736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864686 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c49511-9a94-4bfe-86fd-22fcfaac6437-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.864785 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864752 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qkxr\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-kube-api-access-7qkxr\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.864843 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864818 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.864897 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864850 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.864897 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.864888 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.865132 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.865101 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.865369 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.865350 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.870303 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.870283 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.879488 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.879460 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r"] Nov 02 13:57:50.888280 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.888250 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8"] Nov 02 13:57:50.970264 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.970231 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:50.972020 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.971986 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.972172 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972042 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.972172 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972069 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972172 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972094 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972172 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972129 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.972172 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972161 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe51860-6a34-4dfd-a082-29e7b32e5bda-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972182 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972242 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c49511-9a94-4bfe-86fd-22fcfaac6437-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972260 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972294 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f757\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-kube-api-access-5f757\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972317 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972343 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qkxr\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-kube-api-access-7qkxr\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972392 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972426 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972412 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972888 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972866 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-credential-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.972994 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.972974 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-data\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.973573 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.973511 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c49511-9a94-4bfe-86fd-22fcfaac6437-istiod-ca-cert\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.973696 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.973674 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.973761 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.973738 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.973821 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.973779 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.973873 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.973839 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:50.974896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.974856 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-socket\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.975086 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.975066 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-certs\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.984197 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.984165 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-podinfo\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:50.990449 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:50.990420 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-envoy\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:51.024502 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.023661 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-token\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:51.031221 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.031193 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qkxr\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-kube-api-access-7qkxr\") pod \"e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.099478 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.099638 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.099699 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.099789 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.099836 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.099901 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.099948 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe51860-6a34-4dfd-a082-29e7b32e5bda-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.100033 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.100071 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f757\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-kube-api-access-5f757\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.105593 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.100858 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.168602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.149237 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.168602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.163792 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe51860-6a34-4dfd-a082-29e7b32e5bda-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.168602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.164042 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.168602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.164524 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.170335 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.170262 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:51.204314 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.204270 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9"] Nov 02 13:57:51.222271 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.221948 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.224486 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.224446 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.225727 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.225368 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f757\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-kube-api-access-5f757\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.225727 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.225685 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.227392 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.227071 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.320716 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.320683 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9"] Nov 02 13:57:51.332968 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.332906 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.333488 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.333306 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.333778 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.333757 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.333995 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.333977 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.334151 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.334134 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-kube-api-access-fxjtn\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.334250 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.334238 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.334343 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.333620 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr"] Nov 02 13:57:51.334458 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.334444 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.334662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.334592 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.338653 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.335100 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.508670 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.507390 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529231 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529329 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529381 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529445 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529513 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-kube-api-access-fxjtn\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529575 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529646 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529722 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.529822 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.530395 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.540927 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.541827 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.541212 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.561078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.544976 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.561078 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.546141 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.567637 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.567561 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.592132 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.587594 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.597171 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.596503 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-kube-api-access-fxjtn\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.601502 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.601416 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.614846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.613940 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:51.614846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.614105 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:51.614846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.614209 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:51.620258 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.620222 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:51.637359 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.637323 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr"] Nov 02 13:57:51.637660 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.637642 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w"] Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.797630 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.797722 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.797750 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.797785 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hdf5\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-kube-api-access-5hdf5\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.797823 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.797910 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.798140 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.798183 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.824613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.798265 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.848773 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.846991 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" event={"ID":"255fbdd1-64c6-4d86-94c1-821afa5d6e19","Type":"ContainerStarted","Data":"89fe703be3c774e85a03cf96576a3bffb5be396f3bba0976adf07b5f682e70c8"} Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.906755 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.906821 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.906885 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.906911 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.906951 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hdf5\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-kube-api-access-5hdf5\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.906989 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.907068 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.907291 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.907339 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.908473 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.907911 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.922547 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.919175 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-data\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.922547 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.919456 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-certs\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.922547 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.920099 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istiod-ca-cert\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:51.922547 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.921056 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:52.001564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:51.923474 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-credential-socket\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:52.431620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.431586 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8"] Nov 02 13:57:52.561753 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.561719 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r"] Nov 02 13:57:52.610229 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:57:52.610194 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c49511_9a94_4bfe_86fd_22fcfaac6437.slice/crio-75b98542f5f67d55da421f4eca7be85567e4012c47855ae853ca476fb6a0a078 WatchSource:0}: Error finding container 75b98542f5f67d55da421f4eca7be85567e4012c47855ae853ca476fb6a0a078: Status 404 returned error can't find the container with id 75b98542f5f67d55da421f4eca7be85567e4012c47855ae853ca476fb6a0a078 Nov 02 13:57:52.642434 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.642388 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:52.643130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.643099 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:52.643332 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.643311 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:52.674130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.670214 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:52.674130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.670321 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:52.674130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.670374 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:52.674130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.673846 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-envoy\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:52.674130 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.674032 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-token\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:52.700574 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.700236 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-podinfo\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:52.724076 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.701383 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hdf5\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-kube-api-access-5hdf5\") pod \"e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:52.849591 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:52.831928 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:53.027839 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:53.027744 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" event={"ID":"abe51860-6a34-4dfd-a082-29e7b32e5bda","Type":"ContainerStarted","Data":"2d94c3c745a77271ea5c062963cf65c206fa61910988b09439766d65c614ed6a"} Nov 02 13:57:53.149565 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:53.120965 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" event={"ID":"50c49511-9a94-4bfe-86fd-22fcfaac6437","Type":"ContainerStarted","Data":"75b98542f5f67d55da421f4eca7be85567e4012c47855ae853ca476fb6a0a078"} Nov 02 13:57:53.387636 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:53.378004 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" event={"ID":"255fbdd1-64c6-4d86-94c1-821afa5d6e19","Type":"ContainerStarted","Data":"fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63"} Nov 02 13:57:53.996888 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:53.991652 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:57:54.009736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.009697 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:57:54.010332 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.010020 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:57:54.388646 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.388520 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" event={"ID":"abe51860-6a34-4dfd-a082-29e7b32e5bda","Type":"ContainerStarted","Data":"f50fea0382825324f1c039b999e46a1e44d986bfaeb2c6a99edcc75ca3cafabb"} Nov 02 13:57:54.390394 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.390364 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" event={"ID":"50c49511-9a94-4bfe-86fd-22fcfaac6437","Type":"ContainerStarted","Data":"16a8e3874a55fe606eb8f18d6f551cc712ba0f9f8b8198de3031f2303ae6baf8"} Nov 02 13:57:54.480896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.479223 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podStartSLOduration=4.479201494 podStartE2EDuration="4.479201494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:53.454139263 +0000 UTC m=+891.446527584" watchObservedRunningTime="2026-11-02 13:57:54.479201494 +0000 UTC m=+892.471589782" Nov 02 13:57:54.483268 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.483244 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9"] Nov 02 13:57:54.483378 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.483248 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:54.483378 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.483316 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:54.483378 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.483356 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:54.484343 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.484296 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podStartSLOduration=4.484280728 podStartE2EDuration="4.484280728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:54.46188801 +0000 UTC m=+892.454276295" watchObservedRunningTime="2026-11-02 13:57:54.484280728 +0000 UTC m=+892.476669013" Nov 02 13:57:54.494230 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.494202 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr"] Nov 02 13:57:54.505096 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:57:54.505051 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc792b0b7_4f8e_44af_b12c_f273cb2ebbd8.slice/crio-86d0bb0f4a4e1c62a4129b0ab3bb59a18af00c83208ec581ce9c3ceaf008c400 WatchSource:0}: Error finding container 86d0bb0f4a4e1c62a4129b0ab3bb59a18af00c83208ec581ce9c3ceaf008c400: Status 404 returned error can't find the container with id 86d0bb0f4a4e1c62a4129b0ab3bb59a18af00c83208ec581ce9c3ceaf008c400 Nov 02 13:57:54.509354 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.509319 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:54.509628 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.509601 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:54.509786 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.509770 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:57:54.509926 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.509907 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:57:54.510134 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.510112 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:57:54.510343 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.509340 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:57:54.923586 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.921304 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podStartSLOduration=4.9212830499999995 podStartE2EDuration="4.92128305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:54.620576084 +0000 UTC m=+892.612964392" watchObservedRunningTime="2026-11-02 13:57:54.92128305 +0000 UTC m=+892.913671335" Nov 02 13:57:54.980835 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.980798 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:57:54.981122 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:54.981093 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:57:55.198091 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.197996 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:57:55.316704 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.316658 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:57:55.317065 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.317028 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:57:55.536627 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.528990 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" event={"ID":"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8","Type":"ContainerStarted","Data":"62c2476c9b8b9edb72340be9dba02195c8ed1dc4d7dc180314cc1fda4966b14e"} Nov 02 13:57:55.536950 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.536914 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" event={"ID":"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8","Type":"ContainerStarted","Data":"86d0bb0f4a4e1c62a4129b0ab3bb59a18af00c83208ec581ce9c3ceaf008c400"} Nov 02 13:57:55.653672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.641889 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:57:55.653672 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.641952 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:57:55.660586 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.654964 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" event={"ID":"6b59d0a2-d0c6-459e-98c5-fecd312679a0","Type":"ContainerStarted","Data":"d26e4ecccda1e1b114bff28154a0bb06a1a8b19eb4fe59f2e61caccde817b78e"} Nov 02 13:57:55.662076 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.662043 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" event={"ID":"6b59d0a2-d0c6-459e-98c5-fecd312679a0","Type":"ContainerStarted","Data":"b6c6b5f30789029b6ec917ffa75d45d0a3a4000b83e3f668a10e7f33b8cd8ebd"} Nov 02 13:57:55.775037 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.772953 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podStartSLOduration=4.772934772 podStartE2EDuration="4.772934772s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:55.661893001 +0000 UTC m=+893.654281301" watchObservedRunningTime="2026-11-02 13:57:55.772934772 +0000 UTC m=+893.765323057" Nov 02 13:57:55.859922 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.859574 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:57:55.931562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.922064 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:57:55.931931 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.931902 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:57:55.933139 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.933099 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:57:55.933337 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.932107 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:57:55.933492 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.933461 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:57:55.992562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.986917 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:57:55.992562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.986972 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:57:55.992562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:55.992509 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podStartSLOduration=4.992486652 podStartE2EDuration="4.992486652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:57:55.802827477 +0000 UTC m=+893.795215785" watchObservedRunningTime="2026-11-02 13:57:55.992486652 +0000 UTC m=+893.984874937" Nov 02 13:57:56.239389 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:56.239351 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:57:56.251140 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:56.251100 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:57:56.508766 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:56.508662 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:57:56.509059 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:56.509015 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:57:56.891620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:56.883977 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:57:56.891620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:56.884057 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:57:57.032824 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.032789 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:57:57.033135 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.033092 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:57:57.143774 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.143666 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:57:57.144058 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.144022 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:57:57.229698 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.229660 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:57:57.229978 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.229950 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:57:57.512226 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.512186 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:57:57.521866 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.521728 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:57:57.931896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.930770 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:57:57.931896 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.930827 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:57:57.946168 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.932247 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:57:57.946168 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:57.932289 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:57:58.062099 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:58.062063 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:57:58.062307 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:58.062280 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:57:58.261620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:58.259826 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:57:58.261620 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:58.259889 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:57:58.683352 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:58.683304 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:57:58.684061 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:58.683993 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:57:58.965590 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:58.962618 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 02 13:57:59.064602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.053084 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:57:59.064602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.053975 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:57:59.174844 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.174811 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:57:59.207274 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.207225 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:57:59.423622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.408170 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:57:59.423622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.408247 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:57:59.423622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.408343 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:57:59.423622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.408378 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:57:59.529512 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.529459 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:57:59.529815 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.529784 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:57:59.859704 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.859468 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:57:59.859704 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:57:59.859554 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:58:00.077749 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.077689 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 02 13:58:00.085846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.085799 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:58:00.086182 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.086123 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:58:00.135998 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.111596 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:58:00.135998 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.111689 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:58:00.212571 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.210680 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:58:00.236983 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.236952 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:58:00.370566 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.363619 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:58:00.603564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.577670 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:58:00.603564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.577736 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:58:00.785628 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.785596 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:58:00.888760 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.883781 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:58:00.910387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.910334 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:58:00.985697 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.985659 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:58:00.985997 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:00.985966 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:58:01.028398 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.016133 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:58:01.028914 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.028874 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:58:01.189747 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.189710 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:58:01.190062 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.190029 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:58:01.591846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.591751 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:58:01.592100 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.592071 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:58:01.867671 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.867570 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:58:01.885805 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.885764 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:58:01.927376 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.924651 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:58:01.927376 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.924715 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:58:01.971736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.971266 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:58:01.971736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:01.971324 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:58:02.203074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:02.201812 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:58:02.203074 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:02.201873 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:58:02.594951 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:02.588256 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" start-of-body= Nov 02 13:58:02.594951 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:02.588318 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.85:15021/healthz/ready\": dial tcp 10.132.0.85:15021: connect: connection refused" Nov 02 13:58:02.843793 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:02.843759 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:58:02.844059 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:02.844029 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:58:03.043462 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.026870 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body= Nov 02 13:58:03.043462 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.026934 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" Nov 02 13:58:03.051720 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.051171 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:58:03.051720 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.051231 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:58:03.430582 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.430510 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:58:03.430945 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.430902 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:58:03.934841 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.934805 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:58:03.935141 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.935111 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:58:03.935824 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.935800 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:58:03.935993 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:03.935971 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:58:04.173340 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.173304 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body= Nov 02 13:58:04.173938 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.173906 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" Nov 02 13:58:04.205637 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.203824 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:58:04.232607 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.206526 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:58:04.232607 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.212809 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 13:58:04.325015 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.324900 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:58:04.326180 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.326151 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:58:04.329344 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.329319 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 13:58:04.480574 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.480461 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:58:04.481105 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.480954 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 13:58:04.833950 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.833845 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" start-of-body= Nov 02 13:58:04.834242 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.834200 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": dial tcp 10.132.0.87:15021: connect: connection refused" Nov 02 13:58:04.926395 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.923303 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body= Nov 02 13:58:04.926395 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:04.923706 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" Nov 02 13:58:05.183923 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:05.183892 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:58:05.184506 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:05.184235 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:58:05.185530 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:05.185509 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 13:58:05.931194 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:05.931162 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:58:05.931621 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:05.931600 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:58:05.932764 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:05.932731 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 13:58:06.054480 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:06.054428 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:58:06.056665 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:06.056645 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:58:06.057096 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:06.057076 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 13:58:08.557041 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:58:08.557006 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:58:21.064368 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.064328 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh"] Nov 02 13:58:21.069020 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.068998 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.087967 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.087938 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh"] Nov 02 13:58:21.107957 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.107921 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.108131 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108000 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88wm\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-kube-api-access-c88wm\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.108196 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108169 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.108242 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108202 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e81bc9f-90ea-434d-85e3-26811d3ca796-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.108279 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108249 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.108722 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108696 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.109002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108778 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.109002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108867 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.109002 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.108939 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.209731 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.209699 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88wm\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-kube-api-access-c88wm\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.209954 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.209860 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.209954 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.209900 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e81bc9f-90ea-434d-85e3-26811d3ca796-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.209954 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.209940 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210129 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210062 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210129 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210095 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210139 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210180 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210353 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210327 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-certs\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210414 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210352 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210414 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210394 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-credential-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210640 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210621 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-socket\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210640 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210631 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e81bc9f-90ea-434d-85e3-26811d3ca796-istiod-ca-cert\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.210742 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.210695 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-data\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.212472 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.212444 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-envoy\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.213221 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.213199 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-podinfo\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.228270 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.228242 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-token\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.229070 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.229051 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88wm\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-kube-api-access-c88wm\") pod \"e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.385296 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.385214 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:21.686471 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.686442 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh"] Nov 02 13:58:21.687233 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:58:21.687209 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e81bc9f_90ea_434d_85e3_26811d3ca796.slice/crio-aaf23a3fe6b251690748d03d9faccc099f7ddbe9a6f9d449a79f100a7e807e1c WatchSource:0}: Error finding container aaf23a3fe6b251690748d03d9faccc099f7ddbe9a6f9d449a79f100a7e807e1c: Status 404 returned error can't find the container with id aaf23a3fe6b251690748d03d9faccc099f7ddbe9a6f9d449a79f100a7e807e1c Nov 02 13:58:21.690089 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.690052 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:21.690176 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.690128 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:21.690176 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:21.690157 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:22.390270 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:22.390231 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" event={"ID":"9e81bc9f-90ea-434d-85e3-26811d3ca796","Type":"ContainerStarted","Data":"6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f"} Nov 02 13:58:22.390693 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:22.390326 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" event={"ID":"9e81bc9f-90ea-434d-85e3-26811d3ca796","Type":"ContainerStarted","Data":"aaf23a3fe6b251690748d03d9faccc099f7ddbe9a6f9d449a79f100a7e807e1c"} Nov 02 13:58:22.417734 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:22.417667 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podStartSLOduration=1.417648423 podStartE2EDuration="1.417648423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:58:22.41396946 +0000 UTC m=+920.406357763" watchObservedRunningTime="2026-11-02 13:58:22.417648423 +0000 UTC m=+920.410036708" Nov 02 13:58:23.385914 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:23.385876 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:23.387456 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:23.387434 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 02 13:58:23.387590 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:23.387489 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 02 13:58:24.385753 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:24.385718 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 02 13:58:24.386136 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:24.385778 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 02 13:58:25.385622 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:25.385586 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 02 13:58:25.385893 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:25.385656 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 02 13:58:26.386297 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:26.386257 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 02 13:58:26.386787 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:26.386315 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 02 13:58:27.386404 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:27.386372 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 02 13:58:27.386846 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:27.386422 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 02 13:58:28.386678 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:28.386631 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body= Nov 02 13:58:28.387093 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:28.386719 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" Nov 02 13:58:29.392350 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:29.392317 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:29.393243 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:29.393225 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:29.393934 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:29.393913 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 13:58:35.926901 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:35.926869 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c"] Nov 02 13:58:35.930969 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:35.930943 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:35.969038 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:35.969009 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c"] Nov 02 13:58:36.036769 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.036734 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.036952 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.036858 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.037006 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.036987 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.037057 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.037032 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.037146 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.037119 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ff4abc-91e1-4a5a-ad8c-038733af2132-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.037294 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.037166 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp6px\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-kube-api-access-lp6px\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.037294 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.037250 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.037399 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.037301 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.037436 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.037407 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.129402 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.129364 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d"] Nov 02 13:58:36.133948 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.133921 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.139502 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139476 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.139707 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139613 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.139707 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139675 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.139828 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139807 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.139893 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139873 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.139937 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139910 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.140006 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139962 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ff4abc-91e1-4a5a-ad8c-038733af2132-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.140006 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.139989 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp6px\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-kube-api-access-lp6px\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.140125 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.140024 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.140125 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.140071 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.140373 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.140350 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-credential-socket\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.141035 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.141004 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ff4abc-91e1-4a5a-ad8c-038733af2132-istiod-ca-cert\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.141802 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.141639 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-certs\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.142083 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.142062 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-data\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.144056 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.144034 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-envoy\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.144953 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.144928 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-podinfo\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.154116 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.154084 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d"] Nov 02 13:58:36.172772 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.171842 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-token\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.181155 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.180241 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp6px\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-kube-api-access-lp6px\") pod \"e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.241283 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241245 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241317 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241453 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241421 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241567 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241473 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241617 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241581 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241736 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241709 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241816 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241794 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241860 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241841 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p724\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-kube-api-access-8p724\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.241950 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.241935 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.247832 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.247808 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:36.343359 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343318 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343578 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343399 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343578 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343473 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p724\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-kube-api-access-8p724\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343578 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343557 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343780 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343653 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343780 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343698 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343780 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343768 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343944 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343824 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.343944 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.343894 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.345053 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.344879 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.345053 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.344887 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-certs\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.345053 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.345005 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-credential-socket\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.345522 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.345483 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istiod-ca-cert\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.345687 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.345604 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-data\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.348045 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.348023 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-envoy\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.348193 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.348131 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-podinfo\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.358387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.358325 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-token\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.360501 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.359438 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p724\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-kube-api-access-8p724\") pod \"e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.481139 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.481054 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:36.625496 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:58:36.625468 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ff4abc_91e1_4a5a_ad8c_038733af2132.slice/crio-82f7616140f973adc99cefb8ca7370732195d29c443b6fb1f74bf7cab9d1f5ac WatchSource:0}: Error finding container 82f7616140f973adc99cefb8ca7370732195d29c443b6fb1f74bf7cab9d1f5ac: Status 404 returned error can't find the container with id 82f7616140f973adc99cefb8ca7370732195d29c443b6fb1f74bf7cab9d1f5ac Nov 02 13:58:36.625496 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.625483 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c"] Nov 02 13:58:36.628700 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.628655 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:36.628803 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.628740 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:36.628803 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.628783 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:36.794650 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.794617 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d"] Nov 02 13:58:36.796168 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.795804 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:36.796168 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.795899 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:36.796168 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:36.795946 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:58:37.515776 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:37.515732 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" event={"ID":"21ff4abc-91e1-4a5a-ad8c-038733af2132","Type":"ContainerStarted","Data":"799a1ef633b234828ed889025391ab37d9b7e66b313840f811cf6ff0c85d5066"} Nov 02 13:58:37.516256 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:37.515807 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" event={"ID":"21ff4abc-91e1-4a5a-ad8c-038733af2132","Type":"ContainerStarted","Data":"82f7616140f973adc99cefb8ca7370732195d29c443b6fb1f74bf7cab9d1f5ac"} Nov 02 13:58:37.517451 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:37.517428 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" event={"ID":"9cfe71f5-f880-4ef0-8d45-3b38a89307eb","Type":"ContainerStarted","Data":"316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f"} Nov 02 13:58:37.517563 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:37.517474 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" event={"ID":"9cfe71f5-f880-4ef0-8d45-3b38a89307eb","Type":"ContainerStarted","Data":"322ddecc4c26158d42ec6839214fe075bfa98fbb58ebd5f54aaca32834378626"} Nov 02 13:58:37.555798 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:37.555750 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podStartSLOduration=2.555735459 podStartE2EDuration="2.555735459s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:58:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:58:37.551424529 +0000 UTC m=+935.543812837" watchObservedRunningTime="2026-11-02 13:58:37.555735459 +0000 UTC m=+935.548123743" Nov 02 13:58:37.590733 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:37.590668 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podStartSLOduration=1.590646979 podStartE2EDuration="1.590646979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:58:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:58:37.586042117 +0000 UTC m=+935.578430403" watchObservedRunningTime="2026-11-02 13:58:37.590646979 +0000 UTC m=+935.583035264" Nov 02 13:58:38.258796 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:38.258750 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:38.283561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:38.279971 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Nov 02 13:58:38.283561 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:38.280080 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Nov 02 13:58:38.491637 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:38.482872 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:38.491637 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:38.488659 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 02 13:58:38.491637 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:38.488721 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 02 13:58:38.598528 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:58:38.598448 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:58:39.261602 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:39.261569 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Nov 02 13:58:39.261881 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:39.261844 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Nov 02 13:58:39.482562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:39.481950 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 02 13:58:39.482562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:39.482009 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 02 13:58:40.250484 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:40.250447 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Nov 02 13:58:40.251144 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:40.251112 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Nov 02 13:58:40.484565 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:40.483985 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 02 13:58:40.484565 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:40.484048 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 02 13:58:41.259646 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:41.257467 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Nov 02 13:58:41.259646 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:41.257524 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Nov 02 13:58:41.484387 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:41.484348 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 02 13:58:41.484677 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:41.484644 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 02 13:58:42.251619 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:42.251582 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Nov 02 13:58:42.251924 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:42.251891 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Nov 02 13:58:42.484012 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:42.483974 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 02 13:58:42.484656 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:42.484625 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 02 13:58:43.252563 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:43.252491 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body= Nov 02 13:58:43.252754 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:43.252586 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" Nov 02 13:58:43.481971 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:43.481937 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body= Nov 02 13:58:43.482150 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:43.481987 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" Nov 02 13:58:44.648975 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:44.648936 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:44.651650 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:44.651629 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:44.653121 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:44.653102 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 13:58:44.769383 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:44.769350 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:58:44.904935 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:44.904903 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:44.905375 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:44.905346 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:44.906825 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:44.906805 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 13:58:51.350889 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:51.350836 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:58:51.351693 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:51.351652 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:58:52.050178 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:52.050136 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:58:52.050564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:52.050502 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:58:52.179587 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:52.179498 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:58:52.179999 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:58:52.179867 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:05.721664 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.721624 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf"] Nov 02 13:59:05.729238 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.729207 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.745804 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.745770 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf"] Nov 02 13:59:05.900460 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.900423 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.900707 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.900479 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.900707 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.900497 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.900845 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.900785 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nldtf\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-kube-api-access-nldtf\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.900845 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.900837 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.900969 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.900948 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.901038 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.901021 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.901083 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.901050 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:05.901083 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:05.901069 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.002769 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.002686 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.003166 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.003143 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004053 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.004034 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004153 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.004068 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004153 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.003415 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-certs\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004270 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.004249 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004521 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.004497 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-credential-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004656 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.004548 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-data\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004656 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.004630 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.004656 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.004651 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.005165 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.005140 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nldtf\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-kube-api-access-nldtf\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.005291 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.005205 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.005364 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.005302 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istiod-ca-cert\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.005688 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.005670 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-socket\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.007626 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.007567 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-podinfo\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.007626 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.007573 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-envoy\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.018355 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.018331 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-token\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.024039 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.024012 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nldtf\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-kube-api-access-nldtf\") pod \"e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.076121 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.076091 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:06.383415 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.383386 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf"] Nov 02 13:59:06.383923 ip-10-0-134-60 kubenswrapper[5081]: W1102 13:59:06.383851 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fdcc35a_e07d_482b_a45e_0b5143ce4cfb.slice/crio-544ba2aa4141743c62f931ee0eb790960e4c8376ad13e0384e130f16bfd30057 WatchSource:0}: Error finding container 544ba2aa4141743c62f931ee0eb790960e4c8376ad13e0384e130f16bfd30057: Status 404 returned error can't find the container with id 544ba2aa4141743c62f931ee0eb790960e4c8376ad13e0384e130f16bfd30057 Nov 02 13:59:06.386662 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.386628 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:59:06.386748 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.386697 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:59:06.386748 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.386726 5081 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"} Nov 02 13:59:06.841978 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.841936 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" event={"ID":"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb","Type":"ContainerStarted","Data":"3e3331aa927ddf088351d16a0869cf245a61452062df3c9767bcae0f3b9de983"} Nov 02 13:59:06.842465 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.841994 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" event={"ID":"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb","Type":"ContainerStarted","Data":"544ba2aa4141743c62f931ee0eb790960e4c8376ad13e0384e130f16bfd30057"} Nov 02 13:59:06.889651 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:06.881620 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podStartSLOduration=1.881595989 podStartE2EDuration="1.881595989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 13:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 13:59:06.877709803 +0000 UTC m=+964.870098107" watchObservedRunningTime="2026-11-02 13:59:06.881595989 +0000 UTC m=+964.873984275" Nov 02 13:59:07.077082 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:07.077042 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:07.083107 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:07.082999 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 02 13:59:07.083307 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:07.083116 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 02 13:59:08.076854 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:08.076811 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 02 13:59:08.077246 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:08.076890 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 02 13:59:08.582215 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:59:08.582170 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:59:09.077153 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:09.077118 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 02 13:59:09.077586 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:09.077185 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 02 13:59:10.079560 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:10.078944 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 02 13:59:10.079560 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:10.079021 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 02 13:59:11.077201 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:11.077159 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 02 13:59:11.077449 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:11.077229 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 02 13:59:12.077584 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:12.077514 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 02 13:59:12.078085 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:12.077611 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 02 13:59:13.076701 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:13.076664 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body= Nov 02 13:59:13.076915 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:13.076724 5081 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" Nov 02 13:59:14.081206 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:14.081172 5081 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:14.081613 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:14.081436 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:14.082133 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:14.082118 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 13:59:19.837800 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:19.837749 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:21.334575 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:21.334483 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:59:21.335087 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:21.334643 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:22.196665 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:22.172628 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:59:22.196665 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:22.172712 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.87:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:22.679164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:22.261684 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:59:22.679164 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:22.261765 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:23.871792 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:23.870649 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:24.285873 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:24.285836 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:59:24.519206 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:24.518818 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:24.579989 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:24.579893 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 13:59:24.580298 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:24.580262 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:24.637564 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:24.629505 5081 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" probeResult="failure" output="Get \"https://10.132.0.68:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Nov 02 13:59:25.295656 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:59:25.295619 5081 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.135s" Nov 02 13:59:34.889111 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:34.889070 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 13:59:39.906672 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:59:39.903060 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 13:59:41.193563 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:59:41.186349 5081 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.029s" Nov 02 13:59:42.395526 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:42.395489 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf"] Nov 02 13:59:47.287500 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:47.287460 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr"] Nov 02 13:59:47.288732 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:47.288698 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" podUID="3b408780-90b6-41ce-9ec0-ffc601d3ba67" containerName="maas-api" containerID="cri-o://d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321" gracePeriod=30 Nov 02 13:59:48.002044 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.002000 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:59:48.104104 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.104019 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3b408780-90b6-41ce-9ec0-ffc601d3ba67-kube-api-access-7cnct\" (UniqueName: \"kubernetes.io/projected/3b408780-90b6-41ce-9ec0-ffc601d3ba67-kube-api-access-7cnct\") pod \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " Nov 02 13:59:48.104277 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.104177 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-metrics-certs\") pod \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " Nov 02 13:59:48.104277 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.104248 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-maas-api-tls\") pod \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " Nov 02 13:59:48.104389 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.104367 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3b408780-90b6-41ce-9ec0-ffc601d3ba67-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408780-90b6-41ce-9ec0-ffc601d3ba67-openshift-service-ca\") pod \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\" (UID: \"3b408780-90b6-41ce-9ec0-ffc601d3ba67\") " Nov 02 13:59:48.104916 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.104885 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b408780-90b6-41ce-9ec0-ffc601d3ba67-openshift-service-ca" pod "3b408780-90b6-41ce-9ec0-ffc601d3ba67" (UID: "3b408780-90b6-41ce-9ec0-ffc601d3ba67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 13:59:48.105492 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.105475 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b408780-90b6-41ce-9ec0-ffc601d3ba67-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:48.108754 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.107076 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-metrics-certs" pod "3b408780-90b6-41ce-9ec0-ffc601d3ba67" (UID: "3b408780-90b6-41ce-9ec0-ffc601d3ba67"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:59:48.108754 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.107259 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-maas-api-tls" pod "3b408780-90b6-41ce-9ec0-ffc601d3ba67" (UID: "3b408780-90b6-41ce-9ec0-ffc601d3ba67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:59:48.115475 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.115438 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b408780-90b6-41ce-9ec0-ffc601d3ba67-kube-api-access-7cnct" pod "3b408780-90b6-41ce-9ec0-ffc601d3ba67" (UID: "3b408780-90b6-41ce-9ec0-ffc601d3ba67"). InnerVolumeSpecName "kube-api-access-7cnct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:59:48.207363 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.207330 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:48.207363 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.207363 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cnct\" (UniqueName: \"kubernetes.io/projected/3b408780-90b6-41ce-9ec0-ffc601d3ba67-kube-api-access-7cnct\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:48.207592 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.207378 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b408780-90b6-41ce-9ec0-ffc601d3ba67-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:48.666962 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.666920 5081 generic.go:356] "Generic (PLEG): container finished" podID="3b408780-90b6-41ce-9ec0-ffc601d3ba67" containerID="d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321" exitCode=0 Nov 02 13:59:48.667472 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.667012 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" Nov 02 13:59:48.667472 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.667008 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" event={"ID":"3b408780-90b6-41ce-9ec0-ffc601d3ba67","Type":"ContainerDied","Data":"d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321"} Nov 02 13:59:48.667472 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.667184 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr" event={"ID":"3b408780-90b6-41ce-9ec0-ffc601d3ba67","Type":"ContainerDied","Data":"dd2999b37497d7dad99084ce61448536e0b3488028a6c59ad8f3c183ebe7e461"} Nov 02 13:59:48.667472 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.667222 5081 scope.go:122] "RemoveContainer" containerID="d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321" Nov 02 13:59:48.681052 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.681024 5081 scope.go:122] "RemoveContainer" containerID="d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321" Nov 02 13:59:48.681381 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:59:48.681363 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321\": container with ID starting with d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321 not found: ID does not exist" containerID="d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321" Nov 02 13:59:48.681438 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.681391 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321"} err="failed to get container status \"d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321\": rpc error: code = NotFound desc = could not find container \"d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321\": container with ID starting with d176c39e5f3f49f0709172ad10d9736e90d99530924f8d10e7877d1565dc3321 not found: ID does not exist" Nov 02 13:59:48.688417 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.688391 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr"] Nov 02 13:59:48.704377 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:48.704349 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-1d18fb-7d65846bd4-dfxnr"] Nov 02 13:59:50.179140 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:50.179095 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3b408780-90b6-41ce-9ec0-ffc601d3ba67" path="/var/lib/kubelet/pods/3b408780-90b6-41ce-9ec0-ffc601d3ba67/volumes" Nov 02 13:59:55.097957 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:55.097923 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh"] Nov 02 13:59:55.098475 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:55.098163 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" containerID="cri-o://6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f" gracePeriod=30 Nov 02 13:59:55.102638 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:55.102609 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm"] Nov 02 13:59:55.102911 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:55.102868 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" containerID="cri-o://3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7" gracePeriod=30 Nov 02 13:59:55.110295 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:55.110269 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj"] Nov 02 13:59:55.110684 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:55.110493 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" containerID="cri-o://559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42" gracePeriod=30 Nov 02 13:59:57.419241 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.419196 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" containerID="cri-o://d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed" gracePeriod=45 Nov 02 13:59:57.762322 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.762282 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:59:57.788000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.787730 5081 generic.go:356] "Generic (PLEG): container finished" podID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerID="d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed" exitCode=0 Nov 02 13:59:57.788000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.787792 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" event={"ID":"9499de8a-c0b1-49ea-9c99-c16b1d27e789","Type":"ContainerDied","Data":"d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed"} Nov 02 13:59:57.788000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.787829 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" event={"ID":"9499de8a-c0b1-49ea-9c99-c16b1d27e789","Type":"ContainerDied","Data":"5e54d19106c603df01180b0845c9cb30f5fc084969425096a40ad48ce409e87b"} Nov 02 13:59:57.788000 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.787852 5081 scope.go:122] "RemoveContainer" containerID="d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed" Nov 02 13:59:57.798110 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.798077 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tmp-dir\") pod \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " Nov 02 13:59:57.798652 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.798628 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-model-cache\") pod \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " Nov 02 13:59:57.798852 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.798836 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tls-certs\" (UniqueName: \"kubernetes.io/secret/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tls-certs\") pod \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " Nov 02 13:59:57.799046 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.799014 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-home\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-home\") pod \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " Nov 02 13:59:57.799247 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.799214 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-dshm\") pod \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " Nov 02 13:59:57.799546 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.799499 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9499de8a-c0b1-49ea-9c99-c16b1d27e789-kube-api-access-szqkh\" (UniqueName: \"kubernetes.io/projected/9499de8a-c0b1-49ea-9c99-c16b1d27e789-kube-api-access-szqkh\") pod \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\" (UID: \"9499de8a-c0b1-49ea-9c99-c16b1d27e789\") " Nov 02 13:59:57.843764 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.836139 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9499de8a-c0b1-49ea-9c99-c16b1d27e789-kube-api-access-szqkh" pod "9499de8a-c0b1-49ea-9c99-c16b1d27e789" (UID: "9499de8a-c0b1-49ea-9c99-c16b1d27e789"). InnerVolumeSpecName "kube-api-access-szqkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 13:59:57.843764 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.839627 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-home" pod "9499de8a-c0b1-49ea-9c99-c16b1d27e789" (UID: "9499de8a-c0b1-49ea-9c99-c16b1d27e789"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:59:57.865580 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.847350 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tmp-dir" pod "9499de8a-c0b1-49ea-9c99-c16b1d27e789" (UID: "9499de8a-c0b1-49ea-9c99-c16b1d27e789"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:59:57.865580 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.847529 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-model-cache" pod "9499de8a-c0b1-49ea-9c99-c16b1d27e789" (UID: "9499de8a-c0b1-49ea-9c99-c16b1d27e789"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:59:57.865580 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.863657 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tls-certs" pod "9499de8a-c0b1-49ea-9c99-c16b1d27e789" (UID: "9499de8a-c0b1-49ea-9c99-c16b1d27e789"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 13:59:57.914597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.904721 5081 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-model-cache\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:57.914597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.904756 5081 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tls-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:57.914597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.904771 5081 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-home\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:57.914597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.904784 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szqkh\" (UniqueName: \"kubernetes.io/projected/9499de8a-c0b1-49ea-9c99-c16b1d27e789-kube-api-access-szqkh\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:57.914597 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:57.904797 5081 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-tmp-dir\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:58.028204 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:58.028126 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-dshm" pod "9499de8a-c0b1-49ea-9c99-c16b1d27e789" (UID: "9499de8a-c0b1-49ea-9c99-c16b1d27e789"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 13:59:58.057731 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:58.057656 5081 scope.go:122] "RemoveContainer" containerID="d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed" Nov 02 13:59:58.058332 ip-10-0-134-60 kubenswrapper[5081]: E1102 13:59:58.058150 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed\": container with ID starting with d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed not found: ID does not exist" containerID="d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed" Nov 02 13:59:58.058332 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:58.058188 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed"} err="failed to get container status \"d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed\": rpc error: code = NotFound desc = could not find container \"d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed\": container with ID starting with d3b962490af762e4f94d433a9623b3db4607384976aafa46bab53a3eac6579ed not found: ID does not exist" Nov 02 13:59:58.112941 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:58.112868 5081 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9499de8a-c0b1-49ea-9c99-c16b1d27e789-dshm\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 13:59:58.823590 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:58.806221 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf" Nov 02 13:59:59.122625 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.121778 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf"] Nov 02 13:59:59.133291 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.133257 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-f2e945/simulator-w1-f2e945-kserve-5df97cc7bc-rv7pf"] Nov 02 13:59:59.214740 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.214704 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 13:59:59.228577 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.214979 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 13:59:59.535562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.518750 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 13:59:59.535562 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.518812 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 13:59:59.799856 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.799730 5081 patch_prober.go:29] interesting pod/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 13:59:59.800649 ip-10-0-134-60 kubenswrapper[5081]: I1102 13:59:59.800586 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:00.140440 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.140403 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" path="/var/lib/kubelet/pods/9499de8a-c0b1-49ea-9c99-c16b1d27e789/volumes" Nov 02 14:00:00.223509 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.223427 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47"] Nov 02 14:00:00.224640 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.224458 5081 cpu_manager.go:414] "containerMap: removing container" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" Nov 02 14:00:00.224640 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.224484 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" Nov 02 14:00:00.224640 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.224510 5081 cpu_manager.go:414] "containerMap: removing container" podUID="3b408780-90b6-41ce-9ec0-ffc601d3ba67" containerName="maas-api" Nov 02 14:00:00.224640 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.224516 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3b408780-90b6-41ce-9ec0-ffc601d3ba67" containerName="maas-api" Nov 02 14:00:00.224938 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.224734 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="9499de8a-c0b1-49ea-9c99-c16b1d27e789" containerName="main" Nov 02 14:00:00.224938 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.224755 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="3b408780-90b6-41ce-9ec0-ffc601d3ba67" containerName="maas-api" Nov 02 14:00:00.229406 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.229382 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.234826 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.234786 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jg4tb\"" Nov 02 14:00:00.247010 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.246957 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47"] Nov 02 14:00:00.298672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.298427 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhtdj\" (UniqueName: \"kubernetes.io/projected/283c4feb-95be-47e3-9d31-053a440c6e4b-kube-api-access-qhtdj\") pod \"maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.298672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.298638 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/283c4feb-95be-47e3-9d31-053a440c6e4b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.400502 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.400462 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhtdj\" (UniqueName: \"kubernetes.io/projected/283c4feb-95be-47e3-9d31-053a440c6e4b-kube-api-access-qhtdj\") pod \"maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.401255 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.401227 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/283c4feb-95be-47e3-9d31-053a440c6e4b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.402000 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.401977 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/283c4feb-95be-47e3-9d31-053a440c6e4b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.416479 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.416450 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhtdj\" (UniqueName: \"kubernetes.io/projected/283c4feb-95be-47e3-9d31-053a440c6e4b-kube-api-access-qhtdj\") pod \"maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.443624 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.443592 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 14:00:00.478392 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.477939 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 14:00:00.502760 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.502729 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-socket\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.502958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.502775 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-kube-api-access-c88wm\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-kube-api-access-c88wm\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.502958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.502805 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-token\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-token\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.502958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.502838 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-envoy\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.502958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.502863 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istiod-ca-cert\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.502958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.502917 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-data\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.502983 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-certs\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503010 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-token\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-token\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503038 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-credential-socket\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503097 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-socket\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503131 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-kube-api-access-9qjzw\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-kube-api-access-9qjzw\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503164 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-envoy\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503204 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-certs\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.503259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503258 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-data\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.503697 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503288 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-socket" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.503697 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503308 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-podinfo\") pod \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\" (UID: \"271043d1-af63-44b3-a36a-5d8f3f3c6c5d\") " Nov 02 14:00:00.503697 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503356 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-podinfo\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.503697 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503389 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9e81bc9f-90ea-434d-85e3-26811d3ca796-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e81bc9f-90ea-434d-85e3-26811d3ca796-istiod-ca-cert\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.503697 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.503591 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-credential-socket\") pod \"9e81bc9f-90ea-434d-85e3-26811d3ca796\" (UID: \"9e81bc9f-90ea-434d-85e3-26811d3ca796\") " Nov 02 14:00:00.505410 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.504697 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.505410 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.504794 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-data" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.505410 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.504827 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istiod-ca-cert" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:00.505410 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.504934 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-credential-socket" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.505410 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.505083 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-certs" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.505410 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.505337 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-socket" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.505410 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.505359 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e81bc9f-90ea-434d-85e3-26811d3ca796-istiod-ca-cert" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:00.505887 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.505668 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-credential-socket" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.505887 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.505727 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-certs" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.505887 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.505775 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-data" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.506195 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.506165 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-token" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:00.506308 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.506286 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-envoy" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.510273 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.510230 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-token" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:00.510557 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.510516 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-envoy" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.510651 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.510600 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-kube-api-access-9qjzw" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "kube-api-access-9qjzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:00.511416 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.511390 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-podinfo" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:00.511982 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.511947 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-podinfo" pod "271043d1-af63-44b3-a36a-5d8f3f3c6c5d" (UID: "271043d1-af63-44b3-a36a-5d8f3f3c6c5d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:00.513802 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.513780 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-kube-api-access-c88wm" pod "9e81bc9f-90ea-434d-85e3-26811d3ca796" (UID: "9e81bc9f-90ea-434d-85e3-26811d3ca796"). InnerVolumeSpecName "kube-api-access-c88wm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:00.528960 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.528939 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 14:00:00.605775 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.605737 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-socket\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.605961 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.605812 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-podinfo\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.605961 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.605841 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-kube-api-access-hd7pk\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-kube-api-access-hd7pk\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.606100 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606004 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-socket" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.606100 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606022 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-data\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.606100 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606068 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-certs\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.606262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606125 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-token\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-token\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.606262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606198 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-credential-socket\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.606262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606199 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-data" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.606262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606241 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istiod-ca-cert\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.606470 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606396 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-envoy\") pod \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\" (UID: \"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03\") " Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.606658 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-credential-socket" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607009 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istiod-ca-cert" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607420 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607443 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607459 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607473 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607488 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607503 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qjzw\" (UniqueName: \"kubernetes.io/projected/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-kube-api-access-9qjzw\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607518 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607553 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607567 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607581 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607595 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607608 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607622 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9e81bc9f-90ea-434d-85e3-26811d3ca796-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607636 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607650 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607671 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9e81bc9f-90ea-434d-85e3-26811d3ca796-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607684 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c88wm\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-kube-api-access-c88wm\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607698 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9e81bc9f-90ea-434d-85e3-26811d3ca796-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607716 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607729 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607743 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/271043d1-af63-44b3-a36a-5d8f3f3c6c5d-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.607841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.607807 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-certs" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.608958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.608352 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-podinfo" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:00.608958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.608757 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-token" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:00.608958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.608785 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-kube-api-access-hd7pk" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "kube-api-access-hd7pk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:00.609172 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.609153 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-envoy" pod "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" (UID: "f23c23fc-8ea5-4847-adf2-cac7f1ba0e03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:00.614361 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.614342 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:00.708992 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.708962 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.708992 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.708990 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.709225 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.709000 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hd7pk\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-kube-api-access-hd7pk\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.709225 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.709009 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.709225 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.709018 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:00.833353 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.833320 5081 generic.go:356] "Generic (PLEG): container finished" podID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerID="559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42" exitCode=0 Nov 02 14:00:00.833572 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.833380 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" Nov 02 14:00:00.833572 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.833413 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" event={"ID":"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03","Type":"ContainerDied","Data":"559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42"} Nov 02 14:00:00.833572 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.833524 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj" event={"ID":"f23c23fc-8ea5-4847-adf2-cac7f1ba0e03","Type":"ContainerDied","Data":"f04582f9d45758f7dced1a91fdab96e51ccadd36d86ee80275a57410dad11b7c"} Nov 02 14:00:00.833761 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.833577 5081 scope.go:122] "RemoveContainer" containerID="559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42" Nov 02 14:00:00.835142 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.835119 5081 generic.go:356] "Generic (PLEG): container finished" podID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerID="3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7" exitCode=0 Nov 02 14:00:00.835259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.835174 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" Nov 02 14:00:00.835259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.835212 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" event={"ID":"271043d1-af63-44b3-a36a-5d8f3f3c6c5d","Type":"ContainerDied","Data":"3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7"} Nov 02 14:00:00.835365 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.835279 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm" event={"ID":"271043d1-af63-44b3-a36a-5d8f3f3c6c5d","Type":"ContainerDied","Data":"da179309db3beb2332f8520d127019077acfc74ed5619c6534a29e63203ba2e1"} Nov 02 14:00:00.837254 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.837166 5081 generic.go:356] "Generic (PLEG): container finished" podID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerID="6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f" exitCode=0 Nov 02 14:00:00.837254 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.837203 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" event={"ID":"9e81bc9f-90ea-434d-85e3-26811d3ca796","Type":"ContainerDied","Data":"6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f"} Nov 02 14:00:00.837254 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.837218 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" Nov 02 14:00:00.837254 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.837250 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh" event={"ID":"9e81bc9f-90ea-434d-85e3-26811d3ca796","Type":"ContainerDied","Data":"aaf23a3fe6b251690748d03d9faccc099f7ddbe9a6f9d449a79f100a7e807e1c"} Nov 02 14:00:00.927791 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.926759 5081 scope.go:122] "RemoveContainer" containerID="aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3" Nov 02 14:00:00.936610 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.936242 5081 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 14:00:00.945833 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.943936 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47"] Nov 02 14:00:00.950736 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.950711 5081 scope.go:122] "RemoveContainer" containerID="559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42" Nov 02 14:00:00.951090 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:00.951064 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42\": container with ID starting with 559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42 not found: ID does not exist" containerID="559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42" Nov 02 14:00:00.951220 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.951094 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42"} err="failed to get container status \"559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42\": rpc error: code = NotFound desc = could not find container \"559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42\": container with ID starting with 559154dd9883f414669655febb9261fb38666295fdb258aad002f7933c79aa42 not found: ID does not exist" Nov 02 14:00:00.951220 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.951118 5081 scope.go:122] "RemoveContainer" containerID="aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3" Nov 02 14:00:00.951419 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:00.951403 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3\": container with ID starting with aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3 not found: ID does not exist" containerID="aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3" Nov 02 14:00:00.951461 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.951435 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3"} err="failed to get container status \"aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3\": rpc error: code = NotFound desc = could not find container \"aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3\": container with ID starting with aed3130959f7136c2fd5bbf68ade34c55cc17e8387f068baaadec12aef298ac3 not found: ID does not exist" Nov 02 14:00:00.951461 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.951449 5081 scope.go:122] "RemoveContainer" containerID="3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7" Nov 02 14:00:00.954711 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.954686 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh"] Nov 02 14:00:00.958520 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.958486 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-9m8hh"] Nov 02 14:00:00.962177 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.962157 5081 scope.go:122] "RemoveContainer" containerID="3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7" Nov 02 14:00:00.962670 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:00.962646 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7\": container with ID starting with 3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7 not found: ID does not exist" containerID="3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7" Nov 02 14:00:00.962764 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.962680 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7"} err="failed to get container status \"3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7\": rpc error: code = NotFound desc = could not find container \"3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7\": container with ID starting with 3687758fd65825ebfcf645f58624be3e4bfbd50ccc11b77422cc7820676395f7 not found: ID does not exist" Nov 02 14:00:00.962764 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.962703 5081 scope.go:122] "RemoveContainer" containerID="6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f" Nov 02 14:00:00.976837 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.976813 5081 scope.go:122] "RemoveContainer" containerID="6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f" Nov 02 14:00:00.977753 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:00.977728 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f\": container with ID starting with 6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f not found: ID does not exist" containerID="6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f" Nov 02 14:00:00.977865 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.977760 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f"} err="failed to get container status \"6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f\": rpc error: code = NotFound desc = could not find container \"6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f\": container with ID starting with 6bc6e21b5c60b8f1c059fa35dc51ec934f9a9815e5718779757a73dc735d049f not found: ID does not exist" Nov 02 14:00:00.987809 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.987782 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj"] Nov 02 14:00:00.991370 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:00.991347 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-7vxkj"] Nov 02 14:00:01.013113 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:01.013078 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm"] Nov 02 14:00:01.018844 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:01.018816 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-1d18fb-openshift-default-d9dddfb4c-259nm"] Nov 02 14:00:01.848906 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:01.848873 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" event={"ID":"283c4feb-95be-47e3-9d31-053a440c6e4b","Type":"ContainerStarted","Data":"9c7f73249c7291c9c820a158518f4f0978bbec6d524ac45fc49cb8a954385106"} Nov 02 14:00:02.139965 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:02.139879 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" path="/var/lib/kubelet/pods/271043d1-af63-44b3-a36a-5d8f3f3c6c5d/volumes" Nov 02 14:00:02.140357 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:02.140340 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" path="/var/lib/kubelet/pods/9e81bc9f-90ea-434d-85e3-26811d3ca796/volumes" Nov 02 14:00:02.140816 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:02.140801 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" path="/var/lib/kubelet/pods/f23c23fc-8ea5-4847-adf2-cac7f1ba0e03/volumes" Nov 02 14:00:02.292261 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:02.292229 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm"] Nov 02 14:00:02.292506 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:02.292482 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" podUID="2873d94d-fa24-4939-aff8-c318be872a69" containerName="maas-api" containerID="cri-o://e5a062dd19c8b54ca08657243fb4ff8b682df7f8d1a74556f9809e623694c1c1" gracePeriod=30 Nov 02 14:00:02.868275 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:02.868240 5081 generic.go:356] "Generic (PLEG): container finished" podID="2873d94d-fa24-4939-aff8-c318be872a69" containerID="e5a062dd19c8b54ca08657243fb4ff8b682df7f8d1a74556f9809e623694c1c1" exitCode=0 Nov 02 14:00:02.868780 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:02.868366 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" event={"ID":"2873d94d-fa24-4939-aff8-c318be872a69","Type":"ContainerDied","Data":"e5a062dd19c8b54ca08657243fb4ff8b682df7f8d1a74556f9809e623694c1c1"} Nov 02 14:00:03.138244 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.138194 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 14:00:03.233702 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.223044 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2873d94d-fa24-4939-aff8-c318be872a69-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2873d94d-fa24-4939-aff8-c318be872a69-openshift-service-ca\") pod \"2873d94d-fa24-4939-aff8-c318be872a69\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " Nov 02 14:00:03.233702 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.223316 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2873d94d-fa24-4939-aff8-c318be872a69-kube-api-access-gwvs7\" (UniqueName: \"kubernetes.io/projected/2873d94d-fa24-4939-aff8-c318be872a69-kube-api-access-gwvs7\") pod \"2873d94d-fa24-4939-aff8-c318be872a69\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " Nov 02 14:00:03.233702 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.223557 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-maas-api-tls\") pod \"2873d94d-fa24-4939-aff8-c318be872a69\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " Nov 02 14:00:03.233702 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.223612 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-metrics-certs\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-metrics-certs\") pod \"2873d94d-fa24-4939-aff8-c318be872a69\" (UID: \"2873d94d-fa24-4939-aff8-c318be872a69\") " Nov 02 14:00:03.233702 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.223983 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2873d94d-fa24-4939-aff8-c318be872a69-openshift-service-ca" pod "2873d94d-fa24-4939-aff8-c318be872a69" (UID: "2873d94d-fa24-4939-aff8-c318be872a69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:03.233702 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.224600 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2873d94d-fa24-4939-aff8-c318be872a69-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:03.234120 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.234011 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2873d94d-fa24-4939-aff8-c318be872a69-kube-api-access-gwvs7" pod "2873d94d-fa24-4939-aff8-c318be872a69" (UID: "2873d94d-fa24-4939-aff8-c318be872a69"). InnerVolumeSpecName "kube-api-access-gwvs7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:03.277527 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.277486 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-maas-api-tls" pod "2873d94d-fa24-4939-aff8-c318be872a69" (UID: "2873d94d-fa24-4939-aff8-c318be872a69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:00:03.279120 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.279077 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-metrics-certs" pod "2873d94d-fa24-4939-aff8-c318be872a69" (UID: "2873d94d-fa24-4939-aff8-c318be872a69"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:00:03.329602 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.329309 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:03.329602 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.329337 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwvs7\" (UniqueName: \"kubernetes.io/projected/2873d94d-fa24-4939-aff8-c318be872a69-kube-api-access-gwvs7\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:03.329602 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.329347 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2873d94d-fa24-4939-aff8-c318be872a69-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:03.882261 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.882228 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" Nov 02 14:00:03.882261 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.882245 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm" event={"ID":"2873d94d-fa24-4939-aff8-c318be872a69","Type":"ContainerDied","Data":"cc8e47ee223ff0832cccc6afb7cdd4b73374523d9caa612a7abea978597c0677"} Nov 02 14:00:03.882807 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.882325 5081 scope.go:122] "RemoveContainer" containerID="e5a062dd19c8b54ca08657243fb4ff8b682df7f8d1a74556f9809e623694c1c1" Nov 02 14:00:03.910065 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.910040 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm"] Nov 02 14:00:03.916068 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:03.916044 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-4fc49b-6f4d477496-kvlqm"] Nov 02 14:00:04.186939 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:04.186763 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2873d94d-fa24-4939-aff8-c318be872a69" path="/var/lib/kubelet/pods/2873d94d-fa24-4939-aff8-c318be872a69/volumes" Nov 02 14:00:05.938429 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:05.938386 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" event={"ID":"283c4feb-95be-47e3-9d31-053a440c6e4b","Type":"ContainerStarted","Data":"b6cd1b968e7a533835d54daa9a7817d8550dbc06f7d5234584601763cea9c34b"} Nov 02 14:00:05.976742 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:05.976680 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" podStartSLOduration=1.3312536050000001 podStartE2EDuration="5.976660049s" totalImagesPullingTime="4.645406444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:00:05.973917152 +0000 UTC m=+1023.966305446" watchObservedRunningTime="2026-11-02 14:00:05.976660049 +0000 UTC m=+1023.969048333" Nov 02 14:00:06.947835 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:06.947803 5081 generic.go:356] "Generic (PLEG): container finished" podID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerID="b6cd1b968e7a533835d54daa9a7817d8550dbc06f7d5234584601763cea9c34b" exitCode=60 Nov 02 14:00:06.948276 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:06.947886 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" event={"ID":"283c4feb-95be-47e3-9d31-053a440c6e4b","Type":"ContainerDied","Data":"b6cd1b968e7a533835d54daa9a7817d8550dbc06f7d5234584601763cea9c34b"} Nov 02 14:00:06.948342 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:06.948286 5081 scope.go:122] "RemoveContainer" containerID="b6cd1b968e7a533835d54daa9a7817d8550dbc06f7d5234584601763cea9c34b" Nov 02 14:00:07.311418 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:07.311381 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z"] Nov 02 14:00:07.959356 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:07.959306 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" event={"ID":"283c4feb-95be-47e3-9d31-053a440c6e4b","Type":"ContainerStarted","Data":"a46a5db46e767236d5044b0f828024401504099fbb667be44ebca305c61fbc0f"} Nov 02 14:00:08.557126 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:08.557091 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:00:08.968872 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:08.968840 5081 generic.go:356] "Generic (PLEG): container finished" podID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerID="a46a5db46e767236d5044b0f828024401504099fbb667be44ebca305c61fbc0f" exitCode=60 Nov 02 14:00:08.969337 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:08.968922 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" event={"ID":"283c4feb-95be-47e3-9d31-053a440c6e4b","Type":"ContainerDied","Data":"a46a5db46e767236d5044b0f828024401504099fbb667be44ebca305c61fbc0f"} Nov 02 14:00:08.969337 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:08.968976 5081 scope.go:122] "RemoveContainer" containerID="b6cd1b968e7a533835d54daa9a7817d8550dbc06f7d5234584601763cea9c34b" Nov 02 14:00:08.969337 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:08.969220 5081 scope.go:122] "RemoveContainer" containerID="a46a5db46e767236d5044b0f828024401504099fbb667be44ebca305c61fbc0f" Nov 02 14:00:08.969632 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:08.969611 5081 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47_odh-ai-gateway-infra(283c4feb-95be-47e3-9d31-053a440c6e4b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" Nov 02 14:00:09.978272 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:09.978248 5081 scope.go:122] "RemoveContainer" containerID="a46a5db46e767236d5044b0f828024401504099fbb667be44ebca305c61fbc0f" Nov 02 14:00:09.978730 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:09.978587 5081 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47_odh-ai-gateway-infra(283c4feb-95be-47e3-9d31-053a440c6e4b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" Nov 02 14:00:10.794579 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:10.794526 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz"] Nov 02 14:00:10.794829 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:10.794800 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" containerID="cri-o://4906557d7d67f9e32d82b7738b148994383d3460f37a065e3f5f8dbbdfc11f2e" gracePeriod=30 Nov 02 14:00:10.817824 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:10.817785 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8"] Nov 02 14:00:10.818147 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:10.818102 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" containerID="cri-o://f50fea0382825324f1c039b999e46a1e44d986bfaeb2c6a99edcc75ca3cafabb" gracePeriod=30 Nov 02 14:00:10.832940 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:10.832857 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c"] Nov 02 14:00:10.833579 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:10.833519 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" containerID="cri-o://799a1ef633b234828ed889025391ab37d9b7e66b313840f811cf6ff0c85d5066" gracePeriod=30 Nov 02 14:00:12.070386 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.070352 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9"] Nov 02 14:00:12.071146 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.071115 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" containerID="cri-o://d26e4ecccda1e1b114bff28154a0bb06a1a8b19eb4fe59f2e61caccde817b78e" gracePeriod=30 Nov 02 14:00:12.080336 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.080303 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4"] Nov 02 14:00:12.080585 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.080525 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" containerID="cri-o://e5e20d8c3afb8d7142deaeccfec830b3707260a466ba136ae6456015c159a2db" gracePeriod=30 Nov 02 14:00:12.096977 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.096944 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz"] Nov 02 14:00:12.097174 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.097152 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" containerID="cri-o://43c94e81f8bdc365b36b8d80936f39f82dec56d18dcc1b8d8cfb0094820a07ba" gracePeriod=30 Nov 02 14:00:12.100603 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.100576 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr"] Nov 02 14:00:12.100804 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.100783 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" containerID="cri-o://62c2476c9b8b9edb72340be9dba02195c8ed1dc4d7dc180314cc1fda4966b14e" gracePeriod=30 Nov 02 14:00:12.313559 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:12.312449 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" podUID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" containerName="payload-pre-processing" containerID="cri-o://ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b" gracePeriod=25 Nov 02 14:00:13.492264 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:13.492215 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj"] Nov 02 14:00:13.604143 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:13.604065 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 14:00:13.604422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:13.604392 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:14.166151 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.165788 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 14:00:14.166151 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.165842 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:14.341925 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.341887 5081 patch_prober.go:29] interesting pod/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 14:00:14.342205 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.342175 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:14.587652 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.583465 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w"] Nov 02 14:00:14.587652 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.583733 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" containerID="cri-o://64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab" gracePeriod=30 Nov 02 14:00:14.596868 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.596835 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h"] Nov 02 14:00:14.597112 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.597081 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" containerID="cri-o://09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63" gracePeriod=30 Nov 02 14:00:14.604216 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.604187 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d"] Nov 02 14:00:14.604666 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.604635 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" containerID="cri-o://316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f" gracePeriod=30 Nov 02 14:00:14.653608 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.653572 5081 patch_prober.go:29] interesting pod/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 14:00:14.653780 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.653627 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:14.908296 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.908258 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 14:00:14.908504 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:14.908345 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:16.151520 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.151480 5081 generic.go:356] "Generic (PLEG): container finished" podID="86eda318-c68d-4735-9664-92a444391b24" containerID="4906557d7d67f9e32d82b7738b148994383d3460f37a065e3f5f8dbbdfc11f2e" exitCode=0 Nov 02 14:00:16.152026 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.151632 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" event={"ID":"86eda318-c68d-4735-9664-92a444391b24","Type":"ContainerDied","Data":"4906557d7d67f9e32d82b7738b148994383d3460f37a065e3f5f8dbbdfc11f2e"} Nov 02 14:00:16.152026 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.151686 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" event={"ID":"86eda318-c68d-4735-9664-92a444391b24","Type":"ContainerDied","Data":"f3d235d846a5987220680f389889c911bc969aa7b636fa8dd28a21d62522ecd3"} Nov 02 14:00:16.152026 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.151710 5081 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3d235d846a5987220680f389889c911bc969aa7b636fa8dd28a21d62522ecd3" Nov 02 14:00:16.209324 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.209284 5081 generic.go:356] "Generic (PLEG): container finished" podID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerID="799a1ef633b234828ed889025391ab37d9b7e66b313840f811cf6ff0c85d5066" exitCode=0 Nov 02 14:00:16.209607 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.209418 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" event={"ID":"21ff4abc-91e1-4a5a-ad8c-038733af2132","Type":"ContainerDied","Data":"799a1ef633b234828ed889025391ab37d9b7e66b313840f811cf6ff0c85d5066"} Nov 02 14:00:16.222128 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.222094 5081 generic.go:356] "Generic (PLEG): container finished" podID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerID="f50fea0382825324f1c039b999e46a1e44d986bfaeb2c6a99edcc75ca3cafabb" exitCode=0 Nov 02 14:00:16.222601 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.222327 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" event={"ID":"abe51860-6a34-4dfd-a082-29e7b32e5bda","Type":"ContainerDied","Data":"f50fea0382825324f1c039b999e46a1e44d986bfaeb2c6a99edcc75ca3cafabb"} Nov 02 14:00:16.224663 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.224635 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 14:00:16.250846 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.250817 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 14:00:16.292280 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.274912 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 14:00:16.424222 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424190 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-certs\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.424441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424234 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-data\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.424441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424261 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-socket\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.424441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424289 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-data\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.424441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424321 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-podinfo\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.424441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424352 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-credential-socket\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.424441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424376 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/86eda318-c68d-4735-9664-92a444391b24-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86eda318-c68d-4735-9664-92a444391b24-istio-podinfo\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.424441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424411 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-token\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-token\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.424857 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424445 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-data\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.424857 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424467 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-istio-token\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-istio-token\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.424857 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424490 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-kube-api-access-fwd7l\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-kube-api-access-fwd7l\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.424857 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424516 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/21ff4abc-91e1-4a5a-ad8c-038733af2132-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ff4abc-91e1-4a5a-ad8c-038733af2132-istiod-ca-cert\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.424857 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424576 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86eda318-c68d-4735-9664-92a444391b24-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86eda318-c68d-4735-9664-92a444391b24-istiod-ca-cert\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.424857 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424570 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-data" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.424857 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.424567 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-certs" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.425207 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425170 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-data" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425353 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-socket" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425587 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-credential-socket" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425698 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-data" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425711 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/abe51860-6a34-4dfd-a082-29e7b32e5bda-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe51860-6a34-4dfd-a082-29e7b32e5bda-istiod-ca-cert\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425770 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-credential-socket\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425827 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21ff4abc-91e1-4a5a-ad8c-038733af2132-istiod-ca-cert" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.425884 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-token\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-token\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426009 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-credential-socket" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426090 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-socket\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426132 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-envoy\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426198 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-credential-socket\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426260 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-envoy\") pod \"86eda318-c68d-4735-9664-92a444391b24\" (UID: \"86eda318-c68d-4735-9664-92a444391b24\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426271 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86eda318-c68d-4735-9664-92a444391b24-istiod-ca-cert" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426291 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-envoy\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426321 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-podinfo\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426411 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-kube-api-access-5f757\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-kube-api-access-5f757\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426441 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-certs\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426515 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-kube-api-access-lp6px\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-kube-api-access-lp6px\") pod \"21ff4abc-91e1-4a5a-ad8c-038733af2132\" (UID: \"21ff4abc-91e1-4a5a-ad8c-038733af2132\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426596 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-certs\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426657 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-socket\") pod \"abe51860-6a34-4dfd-a082-29e7b32e5bda\" (UID: \"abe51860-6a34-4dfd-a082-29e7b32e5bda\") " Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.426800 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe51860-6a34-4dfd-a082-29e7b32e5bda-istiod-ca-cert" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427367 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-socket" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427509 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427611 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.427609 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427628 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427641 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427654 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427679 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427693 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21ff4abc-91e1-4a5a-ad8c-038733af2132-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427707 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/86eda318-c68d-4735-9664-92a444391b24-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427722 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe51860-6a34-4dfd-a082-29e7b32e5bda-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427736 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427750 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427862 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-certs" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.427940 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-certs" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.429033 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.428142 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-credential-socket" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.429867 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.429373 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-kube-api-access-fwd7l" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "kube-api-access-fwd7l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:16.429867 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.429592 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-socket" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.429867 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.429680 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-istio-token" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:16.431837 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.431799 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/86eda318-c68d-4735-9664-92a444391b24-istio-podinfo" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:16.431962 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.431935 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-kube-api-access-5f757" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "kube-api-access-5f757". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:16.432287 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.432263 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-podinfo" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:16.432417 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.432393 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-envoy" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.432487 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.432414 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-token" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:16.432487 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.432439 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-token" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:16.432487 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.432464 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-podinfo" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:16.433726 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.433704 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-kube-api-access-lp6px" pod "21ff4abc-91e1-4a5a-ad8c-038733af2132" (UID: "21ff4abc-91e1-4a5a-ad8c-038733af2132"). InnerVolumeSpecName "kube-api-access-lp6px". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:16.434055 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.434039 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-envoy" pod "86eda318-c68d-4735-9664-92a444391b24" (UID: "86eda318-c68d-4735-9664-92a444391b24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.434412 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.434391 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-envoy" pod "abe51860-6a34-4dfd-a082-29e7b32e5bda" (UID: "abe51860-6a34-4dfd-a082-29e7b32e5bda"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:16.529524 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529476 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529524 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529518 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwd7l\" (UniqueName: \"kubernetes.io/projected/86eda318-c68d-4735-9664-92a444391b24-kube-api-access-fwd7l\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529524 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529550 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529565 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529577 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529589 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/86eda318-c68d-4735-9664-92a444391b24-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529600 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529611 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe51860-6a34-4dfd-a082-29e7b32e5bda-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529623 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f757\" (UniqueName: \"kubernetes.io/projected/abe51860-6a34-4dfd-a082-29e7b32e5bda-kube-api-access-5f757\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529638 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21ff4abc-91e1-4a5a-ad8c-038733af2132-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529650 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp6px\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-kube-api-access-lp6px\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529661 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529672 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe51860-6a34-4dfd-a082-29e7b32e5bda-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529684 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529697 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/86eda318-c68d-4735-9664-92a444391b24-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:16.529828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:16.529709 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21ff4abc-91e1-4a5a-ad8c-038733af2132-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.238563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.233510 5081 generic.go:356] "Generic (PLEG): container finished" podID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerID="43c94e81f8bdc365b36b8d80936f39f82dec56d18dcc1b8d8cfb0094820a07ba" exitCode=0 Nov 02 14:00:17.238563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.233569 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" event={"ID":"ff686aee-f0df-446f-9d55-bda087ab3c55","Type":"ContainerDied","Data":"43c94e81f8bdc365b36b8d80936f39f82dec56d18dcc1b8d8cfb0094820a07ba"} Nov 02 14:00:17.238563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.235933 5081 generic.go:356] "Generic (PLEG): container finished" podID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerID="62c2476c9b8b9edb72340be9dba02195c8ed1dc4d7dc180314cc1fda4966b14e" exitCode=0 Nov 02 14:00:17.238563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.236001 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" event={"ID":"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8","Type":"ContainerDied","Data":"62c2476c9b8b9edb72340be9dba02195c8ed1dc4d7dc180314cc1fda4966b14e"} Nov 02 14:00:17.238563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.237778 5081 generic.go:356] "Generic (PLEG): container finished" podID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerID="d26e4ecccda1e1b114bff28154a0bb06a1a8b19eb4fe59f2e61caccde817b78e" exitCode=0 Nov 02 14:00:17.238563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.237851 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" event={"ID":"6b59d0a2-d0c6-459e-98c5-fecd312679a0","Type":"ContainerDied","Data":"d26e4ecccda1e1b114bff28154a0bb06a1a8b19eb4fe59f2e61caccde817b78e"} Nov 02 14:00:17.242041 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.240517 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" Nov 02 14:00:17.242041 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.240552 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c" event={"ID":"21ff4abc-91e1-4a5a-ad8c-038733af2132","Type":"ContainerDied","Data":"82f7616140f973adc99cefb8ca7370732195d29c443b6fb1f74bf7cab9d1f5ac"} Nov 02 14:00:17.242041 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.240608 5081 scope.go:122] "RemoveContainer" containerID="799a1ef633b234828ed889025391ab37d9b7e66b313840f811cf6ff0c85d5066" Nov 02 14:00:17.251632 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.251592 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" event={"ID":"abe51860-6a34-4dfd-a082-29e7b32e5bda","Type":"ContainerDied","Data":"2d94c3c745a77271ea5c062963cf65c206fa61910988b09439766d65c614ed6a"} Nov 02 14:00:17.251782 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.251732 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8" Nov 02 14:00:17.265662 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.265626 5081 generic.go:356] "Generic (PLEG): container finished" podID="d388d07c-c4e2-4479-8a89-89408647220f" containerID="e5e20d8c3afb8d7142deaeccfec830b3707260a466ba136ae6456015c159a2db" exitCode=0 Nov 02 14:00:17.265832 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.265755 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz" Nov 02 14:00:17.268269 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.268180 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" event={"ID":"d388d07c-c4e2-4479-8a89-89408647220f","Type":"ContainerDied","Data":"e5e20d8c3afb8d7142deaeccfec830b3707260a466ba136ae6456015c159a2db"} Nov 02 14:00:17.317257 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.317145 5081 scope.go:122] "RemoveContainer" containerID="f50fea0382825324f1c039b999e46a1e44d986bfaeb2c6a99edcc75ca3cafabb" Nov 02 14:00:17.351856 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.351695 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8"] Nov 02 14:00:17.372557 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.370372 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-dd8r8"] Nov 02 14:00:17.395067 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.394940 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c"] Nov 02 14:00:17.406208 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.406183 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-2w94c"] Nov 02 14:00:17.431885 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.431857 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz"] Nov 02 14:00:17.437276 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.437246 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-1eb567-openshift-default-6c58cbc4b9-x8kdz"] Nov 02 14:00:17.437439 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.437276 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 14:00:17.446117 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.446082 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d388d07c-c4e2-4479-8a89-89408647220f-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d388d07c-c4e2-4479-8a89-89408647220f-istio-podinfo\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.446250 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.446201 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-certs\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.446315 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.446274 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-kube-api-access-h8zxq\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-kube-api-access-h8zxq\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.446388 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.446312 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-data\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.446388 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.446344 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-credential-socket\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.446507 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.446442 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d388d07c-c4e2-4479-8a89-89408647220f-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d388d07c-c4e2-4479-8a89-89408647220f-istiod-ca-cert\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.446507 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.446473 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-socket\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.447063 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.447035 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-credential-socket" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.447267 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.447240 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-certs" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.447364 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.447280 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-socket" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.447437 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.447357 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-istio-token\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-istio-token\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.447437 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.447417 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-envoy\") pod \"d388d07c-c4e2-4479-8a89-89408647220f\" (UID: \"d388d07c-c4e2-4479-8a89-89408647220f\") " Nov 02 14:00:17.447633 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.447609 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d388d07c-c4e2-4479-8a89-89408647220f-istiod-ca-cert" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:17.447978 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.447507 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-data" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.448550 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.448434 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.448550 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.448455 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.448550 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.448468 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.448550 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.448491 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d388d07c-c4e2-4479-8a89-89408647220f-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.448550 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.448503 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.449856 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.449832 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-kube-api-access-h8zxq" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "kube-api-access-h8zxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.450024 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.450005 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d388d07c-c4e2-4479-8a89-89408647220f-istio-podinfo" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:17.450628 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.450604 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-envoy" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.450912 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.450896 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-istio-token" pod "d388d07c-c4e2-4479-8a89-89408647220f" (UID: "d388d07c-c4e2-4479-8a89-89408647220f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.550287 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.550245 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d388d07c-c4e2-4479-8a89-89408647220f-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.550287 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.550286 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8zxq\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-kube-api-access-h8zxq\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.550568 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.550300 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d388d07c-c4e2-4479-8a89-89408647220f-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.550568 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.550316 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d388d07c-c4e2-4479-8a89-89408647220f-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.589086 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.589060 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 14:00:17.591869 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.591845 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 14:00:17.600579 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.597689 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 14:00:17.650999 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.650912 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istiod-ca-cert\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.651144 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651013 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-certs\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.651262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651232 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-token\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-token\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.651359 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651335 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-podinfo\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.651798 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651757 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-kube-api-access-fxjtn\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.651966 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651818 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-token\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-token\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.651966 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651828 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istiod-ca-cert" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:17.651966 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651849 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-socket\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.651966 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651890 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-credential-socket\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.651966 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651935 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-data\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.651972 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-socket\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652023 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-token\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-token\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652053 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-podinfo\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652081 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-certs\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652140 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-credential-socket\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652144 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-certs" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652220 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-envoy\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652251 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-envoy\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.652302 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652303 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-certs\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652344 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-credential-socket\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652400 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-kube-api-access-9frp7\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-kube-api-access-9frp7\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652463 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ff686aee-f0df-446f-9d55-bda087ab3c55-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff686aee-f0df-446f-9d55-bda087ab3c55-istiod-ca-cert\") pod \"ff686aee-f0df-446f-9d55-bda087ab3c55\" (UID: \"ff686aee-f0df-446f-9d55-bda087ab3c55\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652492 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-socket\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652558 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-podinfo\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652590 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-data\") pod \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\" (UID: \"6b59d0a2-d0c6-459e-98c5-fecd312679a0\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652611 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-envoy\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652637 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-data\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652657 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istiod-ca-cert\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.652806 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652691 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-kube-api-access-5hdf5\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-kube-api-access-5hdf5\") pod \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\" (UID: \"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8\") " Nov 02 14:00:17.653310 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.653226 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.653310 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.653240 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.657751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.652344 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-data" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.657751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.654309 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-token" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.657751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.655443 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-token" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.657751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.655641 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-socket" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.657751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.655995 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-credential-socket" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.657751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.656048 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-kube-api-access-5hdf5" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "kube-api-access-5hdf5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.657751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.656263 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-socket" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.659617 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.659424 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-podinfo" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:17.659707 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.659685 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-certs" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.659834 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.659808 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-data" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.659914 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.659882 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-credential-socket" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.660051 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.660024 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-data" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.661456 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.660407 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istiod-ca-cert" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:17.661456 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.661302 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-podinfo" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:17.661808 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.661783 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-certs" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.662529 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.662502 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-envoy" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.663436 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.662946 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff686aee-f0df-446f-9d55-bda087ab3c55-istiod-ca-cert" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:17.663436 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.663189 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-credential-socket" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.663436 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.663368 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-socket" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.664046 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.664019 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-envoy" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.664661 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.664625 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-kube-api-access-9frp7" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "kube-api-access-9frp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.664842 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.664818 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-kube-api-access-fxjtn" pod "6b59d0a2-d0c6-459e-98c5-fecd312679a0" (UID: "6b59d0a2-d0c6-459e-98c5-fecd312679a0"). InnerVolumeSpecName "kube-api-access-fxjtn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.664916 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.664856 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-envoy" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:17.665229 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.665209 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-token" pod "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" (UID: "c792b0b7-4f8e-44af-b12c-f273cb2ebbd8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:17.666368 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.666347 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-podinfo" pod "ff686aee-f0df-446f-9d55-bda087ab3c55" (UID: "ff686aee-f0df-446f-9d55-bda087ab3c55"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:17.755147 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755107 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755147 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755151 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755166 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755183 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755198 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9frp7\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-kube-api-access-9frp7\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755212 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ff686aee-f0df-446f-9d55-bda087ab3c55-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755224 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755238 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755250 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755265 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755277 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755290 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755304 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hdf5\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-kube-api-access-5hdf5\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755316 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755329 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755342 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxjtn\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-kube-api-access-fxjtn\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755355 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b59d0a2-d0c6-459e-98c5-fecd312679a0-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755367 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755382 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b59d0a2-d0c6-459e-98c5-fecd312679a0-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755395 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755408 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755421 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755433 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755450 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.755737 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.755462 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ff686aee-f0df-446f-9d55-bda087ab3c55-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:17.861644 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.861606 5081 patch_prober.go:29] interesting pod/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 14:00:17.861832 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:17.861677 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:18.138620 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.138585 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" path="/var/lib/kubelet/pods/21ff4abc-91e1-4a5a-ad8c-038733af2132/volumes" Nov 02 14:00:18.139120 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.139106 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86eda318-c68d-4735-9664-92a444391b24" path="/var/lib/kubelet/pods/86eda318-c68d-4735-9664-92a444391b24/volumes" Nov 02 14:00:18.139584 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.139570 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" path="/var/lib/kubelet/pods/abe51860-6a34-4dfd-a082-29e7b32e5bda/volumes" Nov 02 14:00:18.275951 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.275924 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" Nov 02 14:00:18.275951 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.275941 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4" event={"ID":"d388d07c-c4e2-4479-8a89-89408647220f","Type":"ContainerDied","Data":"e5b4245eb6d1ed0b3932b0dbe0d3633611d1647638dedc33d15e2d526c1ced73"} Nov 02 14:00:18.276437 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.276002 5081 scope.go:122] "RemoveContainer" containerID="e5e20d8c3afb8d7142deaeccfec830b3707260a466ba136ae6456015c159a2db" Nov 02 14:00:18.277681 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.277660 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" Nov 02 14:00:18.277825 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.277665 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz" event={"ID":"ff686aee-f0df-446f-9d55-bda087ab3c55","Type":"ContainerDied","Data":"b16b50ee294086315d1b82816c61e7612758a5780a9e1ff0966088d954546985"} Nov 02 14:00:18.279252 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.279231 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" event={"ID":"c792b0b7-4f8e-44af-b12c-f273cb2ebbd8","Type":"ContainerDied","Data":"86d0bb0f4a4e1c62a4129b0ab3bb59a18af00c83208ec581ce9c3ceaf008c400"} Nov 02 14:00:18.279372 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.279262 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr" Nov 02 14:00:18.281837 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.281243 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" Nov 02 14:00:18.281837 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.281696 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9" event={"ID":"6b59d0a2-d0c6-459e-98c5-fecd312679a0","Type":"ContainerDied","Data":"b6c6b5f30789029b6ec917ffa75d45d0a3a4000b83e3f668a10e7f33b8cd8ebd"} Nov 02 14:00:18.289817 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.289795 5081 scope.go:122] "RemoveContainer" containerID="43c94e81f8bdc365b36b8d80936f39f82dec56d18dcc1b8d8cfb0094820a07ba" Nov 02 14:00:18.299465 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.299446 5081 scope.go:122] "RemoveContainer" containerID="62c2476c9b8b9edb72340be9dba02195c8ed1dc4d7dc180314cc1fda4966b14e" Nov 02 14:00:18.309328 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.309308 5081 scope.go:122] "RemoveContainer" containerID="d26e4ecccda1e1b114bff28154a0bb06a1a8b19eb4fe59f2e61caccde817b78e" Nov 02 14:00:18.316241 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.316211 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9"] Nov 02 14:00:18.321712 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.321693 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-nfdd9"] Nov 02 14:00:18.336886 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.336852 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz"] Nov 02 14:00:18.346109 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.346079 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-kfrdz"] Nov 02 14:00:18.362099 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.362069 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr"] Nov 02 14:00:18.365954 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.365926 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-9bqnr"] Nov 02 14:00:18.379898 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.379867 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4"] Nov 02 14:00:18.386692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.386668 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-f2e945-openshift-default-6b59fbb98f-wxhh4"] Nov 02 14:00:18.492716 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:18.492668 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" podUID="33df33e4-615f-4113-92ac-55e523b1f4a2" containerName="payload-pre-processing" containerID="cri-o://6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259" gracePeriod=25 Nov 02 14:00:19.982562 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:19.960974 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.001906 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-kube-api-access-pdhlc\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-kube-api-access-pdhlc\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.001963 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-envoy\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.002025 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-token\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-token\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.002085 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-data\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.002135 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-socket\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.002167 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-podinfo\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.002239 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-credential-socket\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.002326 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc6d8abf-df1f-4eab-8022-8e881d76d904-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6d8abf-df1f-4eab-8022-8e881d76d904-istiod-ca-cert\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.025993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.002388 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-certs\") pod \"bc6d8abf-df1f-4eab-8022-8e881d76d904\" (UID: \"bc6d8abf-df1f-4eab-8022-8e881d76d904\") " Nov 02 14:00:20.031354 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.030945 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-data" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.032778 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.032483 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-socket" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.033031 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.033005 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.033124 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.033038 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.033431 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.033408 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc6d8abf-df1f-4eab-8022-8e881d76d904-istiod-ca-cert" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:20.033687 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.033668 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-credential-socket" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.033919 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.033885 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-certs" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.053559 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.049385 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-podinfo" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:20.057961 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.054473 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-token" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:20.057961 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.054711 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-kube-api-access-pdhlc" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "kube-api-access-pdhlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:20.057961 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.054792 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-envoy" pod "bc6d8abf-df1f-4eab-8022-8e881d76d904" (UID: "bc6d8abf-df1f-4eab-8022-8e881d76d904"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.087406 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.087376 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 14:00:20.107403 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.107380 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 14:00:20.135145 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.135114 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdhlc\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-kube-api-access-pdhlc\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.135305 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.135149 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.135305 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.135165 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.135305 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.135178 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc6d8abf-df1f-4eab-8022-8e881d76d904-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.135305 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.135193 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.135305 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.135205 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc6d8abf-df1f-4eab-8022-8e881d76d904-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.135305 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.135218 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc6d8abf-df1f-4eab-8022-8e881d76d904-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.144026 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.143988 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" path="/var/lib/kubelet/pods/6b59d0a2-d0c6-459e-98c5-fecd312679a0/volumes" Nov 02 14:00:20.144948 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.144821 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" path="/var/lib/kubelet/pods/c792b0b7-4f8e-44af-b12c-f273cb2ebbd8/volumes" Nov 02 14:00:20.145475 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.145451 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d388d07c-c4e2-4479-8a89-89408647220f" path="/var/lib/kubelet/pods/d388d07c-c4e2-4479-8a89-89408647220f/volumes" Nov 02 14:00:20.157140 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.146630 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" path="/var/lib/kubelet/pods/ff686aee-f0df-446f-9d55-bda087ab3c55/volumes" Nov 02 14:00:20.162058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.160151 5081 scope.go:122] "RemoveContainer" containerID="a46a5db46e767236d5044b0f828024401504099fbb667be44ebca305c61fbc0f" Nov 02 14:00:20.236523 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236488 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-podinfo\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.236675 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236581 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-podinfo\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.236675 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236609 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-credential-socket\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.236675 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236634 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-envoy\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.236675 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236655 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-socket\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.236909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236701 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-certs\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.236909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236731 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istiod-ca-cert\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.236909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236784 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-token\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-token\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.236909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236822 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-data\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.236909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236866 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-certs\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.236909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236894 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-credential-socket" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.236909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236905 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-envoy\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.237265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236945 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-credential-socket\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.237265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.236983 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-kube-api-access-8p724\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-kube-api-access-8p724\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.237265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237076 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-token\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-token\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.237265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237107 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-data\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.237265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237139 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-data" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.237265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237150 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-kube-api-access-76h9r\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-kube-api-access-76h9r\") pod \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\" (UID: \"9d9a70f0-14fd-499d-8c22-3c759273ca0d\") " Nov 02 14:00:20.237265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237166 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-socket" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.237835 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237320 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-socket\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.237835 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237389 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istiod-ca-cert\") pod \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\" (UID: \"9cfe71f5-f880-4ef0-8d45-3b38a89307eb\") " Nov 02 14:00:20.237835 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237398 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istiod-ca-cert" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:20.237835 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237684 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-certs" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.238034 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.237983 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istiod-ca-cert" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238202 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-socket" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238383 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238406 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238421 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238436 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238453 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238487 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.238719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.238503 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.239191 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.239072 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-data" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.239191 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.239147 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-certs" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.239287 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.239203 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-credential-socket" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.317855 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.317103 5081 generic.go:356] "Generic (PLEG): container finished" podID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerID="316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f" exitCode=0 Nov 02 14:00:20.317855 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.317212 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" event={"ID":"9cfe71f5-f880-4ef0-8d45-3b38a89307eb","Type":"ContainerDied","Data":"316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f"} Nov 02 14:00:20.317855 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.317263 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" event={"ID":"9cfe71f5-f880-4ef0-8d45-3b38a89307eb","Type":"ContainerDied","Data":"322ddecc4c26158d42ec6839214fe075bfa98fbb58ebd5f54aaca32834378626"} Nov 02 14:00:20.317855 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.317292 5081 scope.go:122] "RemoveContainer" containerID="316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f" Nov 02 14:00:20.317855 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.317421 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d" Nov 02 14:00:20.328711 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.328032 5081 generic.go:356] "Generic (PLEG): container finished" podID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerID="09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63" exitCode=0 Nov 02 14:00:20.328711 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.328152 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" event={"ID":"9d9a70f0-14fd-499d-8c22-3c759273ca0d","Type":"ContainerDied","Data":"09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63"} Nov 02 14:00:20.328711 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.328203 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" event={"ID":"9d9a70f0-14fd-499d-8c22-3c759273ca0d","Type":"ContainerDied","Data":"6bc1bc250bbd1a2d38264e97f45ea3e3f9682ee5206fa2eeb21995e05a66327d"} Nov 02 14:00:20.328711 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.328282 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h" Nov 02 14:00:20.332661 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.331073 5081 generic.go:356] "Generic (PLEG): container finished" podID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerID="64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab" exitCode=0 Nov 02 14:00:20.332661 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.331201 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" event={"ID":"bc6d8abf-df1f-4eab-8022-8e881d76d904","Type":"ContainerDied","Data":"64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab"} Nov 02 14:00:20.332661 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.331249 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" event={"ID":"bc6d8abf-df1f-4eab-8022-8e881d76d904","Type":"ContainerDied","Data":"7cc1e11b3a5659e0631a8b7e03441e71e01eb214cba1ae582516466432207a5a"} Nov 02 14:00:20.332661 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.331326 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w" Nov 02 14:00:20.369380 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.369346 5081 scope.go:122] "RemoveContainer" containerID="316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f" Nov 02 14:00:20.374672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.369749 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-podinfo" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:20.374672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.370350 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-token" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:20.374672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.370445 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-podinfo" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:20.374672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.370457 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-kube-api-access-76h9r" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "kube-api-access-76h9r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:20.374672 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:20.370581 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f\": container with ID starting with 316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f not found: ID does not exist" containerID="316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f" Nov 02 14:00:20.374672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.370616 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f"} err="failed to get container status \"316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f\": rpc error: code = NotFound desc = could not find container \"316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f\": container with ID starting with 316638ac2d26a692a67a68a6f83fafdb0d166d338d9c184597faa7251972bc8f not found: ID does not exist" Nov 02 14:00:20.374672 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.370645 5081 scope.go:122] "RemoveContainer" containerID="09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63" Nov 02 14:00:20.375235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.374827 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.375235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.374943 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76h9r\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-kube-api-access-76h9r\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.375235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.374953 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.375235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.374968 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.375235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.374978 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.375235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.374986 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.375235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.375110 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.391624 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.390297 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-kube-api-access-8p724" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "kube-api-access-8p724". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:20.391624 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.390561 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-envoy" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.391624 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.390874 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-envoy" pod "9cfe71f5-f880-4ef0-8d45-3b38a89307eb" (UID: "9cfe71f5-f880-4ef0-8d45-3b38a89307eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:20.391624 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.391353 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-token" pod "9d9a70f0-14fd-499d-8c22-3c759273ca0d" (UID: "9d9a70f0-14fd-499d-8c22-3c759273ca0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:20.391624 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.391392 5081 scope.go:122] "RemoveContainer" containerID="09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63" Nov 02 14:00:20.392064 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:20.391951 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63\": container with ID starting with 09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63 not found: ID does not exist" containerID="09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63" Nov 02 14:00:20.392064 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.391981 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63"} err="failed to get container status \"09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63\": rpc error: code = NotFound desc = could not find container \"09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63\": container with ID starting with 09c996decbec6e4fbcd096f88beca6d992266006028e839a61b65268f6385b63 not found: ID does not exist" Nov 02 14:00:20.392064 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.392001 5081 scope.go:122] "RemoveContainer" containerID="64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab" Nov 02 14:00:20.405161 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.405123 5081 scope.go:122] "RemoveContainer" containerID="64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab" Nov 02 14:00:20.405664 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:20.405639 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab\": container with ID starting with 64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab not found: ID does not exist" containerID="64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab" Nov 02 14:00:20.405772 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.405670 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab"} err="failed to get container status \"64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab\": rpc error: code = NotFound desc = could not find container \"64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab\": container with ID starting with 64bfc2b076162e52e3b3f4791973131fcc1b76b0da205d7d5891d0308c87c7ab not found: ID does not exist" Nov 02 14:00:20.408786 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.408740 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w"] Nov 02 14:00:20.417232 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.417212 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-2dq4w"] Nov 02 14:00:20.476123 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.476086 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.476123 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.476118 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.476123 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.476129 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p724\" (UniqueName: \"kubernetes.io/projected/9cfe71f5-f880-4ef0-8d45-3b38a89307eb-kube-api-access-8p724\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.476398 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.476140 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d9a70f0-14fd-499d-8c22-3c759273ca0d-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:20.537710 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.537675 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" podUID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 02 14:00:20.660065 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.659998 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d"] Nov 02 14:00:20.665790 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.665766 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-52r8d"] Nov 02 14:00:20.694490 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.692592 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h"] Nov 02 14:00:20.697728 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:20.697699 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-4fc49b-openshift-default-798b7b5cc5-p7f9h"] Nov 02 14:00:21.342292 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:21.342260 5081 generic.go:356] "Generic (PLEG): container finished" podID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerID="f34cf3373a95c50ddb7d3a1f087aaf8ee8dbbb7e2a9d0f1ec354fce79d3f71b4" exitCode=60 Nov 02 14:00:21.342707 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:21.342338 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" event={"ID":"283c4feb-95be-47e3-9d31-053a440c6e4b","Type":"ContainerDied","Data":"f34cf3373a95c50ddb7d3a1f087aaf8ee8dbbb7e2a9d0f1ec354fce79d3f71b4"} Nov 02 14:00:21.342707 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:21.342431 5081 scope.go:122] "RemoveContainer" containerID="a46a5db46e767236d5044b0f828024401504099fbb667be44ebca305c61fbc0f" Nov 02 14:00:21.342901 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:21.342886 5081 scope.go:122] "RemoveContainer" containerID="f34cf3373a95c50ddb7d3a1f087aaf8ee8dbbb7e2a9d0f1ec354fce79d3f71b4" Nov 02 14:00:21.343231 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:21.343211 5081 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47_odh-ai-gateway-infra(283c4feb-95be-47e3-9d31-053a440c6e4b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" Nov 02 14:00:21.543191 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:21.543155 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" podUID="33df33e4-615f-4113-92ac-55e523b1f4a2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 02 14:00:22.138376 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.138341 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" path="/var/lib/kubelet/pods/9cfe71f5-f880-4ef0-8d45-3b38a89307eb/volumes" Nov 02 14:00:22.138876 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.138861 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" path="/var/lib/kubelet/pods/9d9a70f0-14fd-499d-8c22-3c759273ca0d/volumes" Nov 02 14:00:22.139284 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.139272 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" path="/var/lib/kubelet/pods/bc6d8abf-df1f-4eab-8022-8e881d76d904/volumes" Nov 02 14:00:22.373710 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.373678 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47"] Nov 02 14:00:22.550076 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.550049 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:22.606004 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.605967 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/283c4feb-95be-47e3-9d31-053a440c6e4b-kube-api-access-qhtdj\" (UniqueName: \"kubernetes.io/projected/283c4feb-95be-47e3-9d31-053a440c6e4b-kube-api-access-qhtdj\") pod \"283c4feb-95be-47e3-9d31-053a440c6e4b\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " Nov 02 14:00:22.606164 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.606026 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/283c4feb-95be-47e3-9d31-053a440c6e4b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/283c4feb-95be-47e3-9d31-053a440c6e4b-maas-api-service-ca\") pod \"283c4feb-95be-47e3-9d31-053a440c6e4b\" (UID: \"283c4feb-95be-47e3-9d31-053a440c6e4b\") " Nov 02 14:00:22.606418 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.606394 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/283c4feb-95be-47e3-9d31-053a440c6e4b-maas-api-service-ca" pod "283c4feb-95be-47e3-9d31-053a440c6e4b" (UID: "283c4feb-95be-47e3-9d31-053a440c6e4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:22.606770 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.606749 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/283c4feb-95be-47e3-9d31-053a440c6e4b-maas-api-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:22.608957 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.608932 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283c4feb-95be-47e3-9d31-053a440c6e4b-kube-api-access-qhtdj" pod "283c4feb-95be-47e3-9d31-053a440c6e4b" (UID: "283c4feb-95be-47e3-9d31-053a440c6e4b"). InnerVolumeSpecName "kube-api-access-qhtdj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:22.708217 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:22.708131 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhtdj\" (UniqueName: \"kubernetes.io/projected/283c4feb-95be-47e3-9d31-053a440c6e4b-kube-api-access-qhtdj\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:23.358790 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:23.358754 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" Nov 02 14:00:23.358976 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:23.358790 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47" event={"ID":"283c4feb-95be-47e3-9d31-053a440c6e4b","Type":"ContainerDied","Data":"9c7f73249c7291c9c820a158518f4f0978bbec6d524ac45fc49cb8a954385106"} Nov 02 14:00:23.358976 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:23.358849 5081 scope.go:122] "RemoveContainer" containerID="f34cf3373a95c50ddb7d3a1f087aaf8ee8dbbb7e2a9d0f1ec354fce79d3f71b4" Nov 02 14:00:23.389646 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:23.389359 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47"] Nov 02 14:00:23.396341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:23.396239 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-ee7df2-29893800-47s47"] Nov 02 14:00:24.139101 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:24.139070 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" path="/var/lib/kubelet/pods/283c4feb-95be-47e3-9d31-053a440c6e4b/volumes" Nov 02 14:00:24.987048 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:24.987012 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv"] Nov 02 14:00:24.987459 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:24.987255 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" podUID="3536ef66-306b-4eac-8aba-3b3c64e4fb17" containerName="maas-api" containerID="cri-o://11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a" gracePeriod=30 Nov 02 14:00:25.286639 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.277154 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 14:00:25.353910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.352860 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-metrics-certs\") pod \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " Nov 02 14:00:25.353910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.353027 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3536ef66-306b-4eac-8aba-3b3c64e4fb17-kube-api-access-6qrqj\" (UniqueName: \"kubernetes.io/projected/3536ef66-306b-4eac-8aba-3b3c64e4fb17-kube-api-access-6qrqj\") pod \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " Nov 02 14:00:25.353910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.353062 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-maas-api-tls\") pod \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " Nov 02 14:00:25.353910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.353128 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3536ef66-306b-4eac-8aba-3b3c64e4fb17-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3536ef66-306b-4eac-8aba-3b3c64e4fb17-openshift-service-ca\") pod \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\" (UID: \"3536ef66-306b-4eac-8aba-3b3c64e4fb17\") " Nov 02 14:00:25.354867 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.354477 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3536ef66-306b-4eac-8aba-3b3c64e4fb17-openshift-service-ca" pod "3536ef66-306b-4eac-8aba-3b3c64e4fb17" (UID: "3536ef66-306b-4eac-8aba-3b3c64e4fb17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:25.361182 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.361127 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-metrics-certs" pod "3536ef66-306b-4eac-8aba-3b3c64e4fb17" (UID: "3536ef66-306b-4eac-8aba-3b3c64e4fb17"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:00:25.411834 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.411120 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-maas-api-tls" pod "3536ef66-306b-4eac-8aba-3b3c64e4fb17" (UID: "3536ef66-306b-4eac-8aba-3b3c64e4fb17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:00:25.411834 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.411426 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3536ef66-306b-4eac-8aba-3b3c64e4fb17-kube-api-access-6qrqj" pod "3536ef66-306b-4eac-8aba-3b3c64e4fb17" (UID: "3536ef66-306b-4eac-8aba-3b3c64e4fb17"). InnerVolumeSpecName "kube-api-access-6qrqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:25.421613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.418449 5081 generic.go:356] "Generic (PLEG): container finished" podID="3536ef66-306b-4eac-8aba-3b3c64e4fb17" containerID="11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a" exitCode=0 Nov 02 14:00:25.421613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.418667 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" event={"ID":"3536ef66-306b-4eac-8aba-3b3c64e4fb17","Type":"ContainerDied","Data":"11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a"} Nov 02 14:00:25.421613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.418746 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" event={"ID":"3536ef66-306b-4eac-8aba-3b3c64e4fb17","Type":"ContainerDied","Data":"9f03d41428de9e24116d8d09ee0b920909b03c4e396ac4c00fbfda9f2c4180c7"} Nov 02 14:00:25.421613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.418779 5081 scope.go:122] "RemoveContainer" containerID="11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a" Nov 02 14:00:25.421613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.418928 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv" Nov 02 14:00:25.439573 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.439515 5081 scope.go:122] "RemoveContainer" containerID="11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a" Nov 02 14:00:25.439918 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:25.439892 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a\": container with ID starting with 11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a not found: ID does not exist" containerID="11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a" Nov 02 14:00:25.440016 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.439930 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a"} err="failed to get container status \"11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a\": rpc error: code = NotFound desc = could not find container \"11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a\": container with ID starting with 11a5ab2b4f263e374a53c36392da068992982625c9bd65e491911e555a9f091a not found: ID does not exist" Nov 02 14:00:25.455192 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.455152 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3536ef66-306b-4eac-8aba-3b3c64e4fb17-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:25.455192 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.455182 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:25.455192 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.455196 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qrqj\" (UniqueName: \"kubernetes.io/projected/3536ef66-306b-4eac-8aba-3b3c64e4fb17-kube-api-access-6qrqj\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:25.455440 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.455209 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3536ef66-306b-4eac-8aba-3b3c64e4fb17-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:25.459217 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.459177 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv"] Nov 02 14:00:25.467204 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:25.467174 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-9e0c2f-865b45bfc4-6t4qv"] Nov 02 14:00:26.138599 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:26.138564 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3536ef66-306b-4eac-8aba-3b3c64e4fb17" path="/var/lib/kubelet/pods/3536ef66-306b-4eac-8aba-3b3c64e4fb17/volumes" Nov 02 14:00:26.865570 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:26.865521 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:00:29.578694 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:29.578647 5081 patch_prober.go:29] interesting pod/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:00:29.579301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:29.579266 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:00:30.138179 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:30.138140 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:00:30.138579 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:30.138518 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:00:30.539064 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:30.539027 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" podUID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 02 14:00:30.906861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:30.906834 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h"] Nov 02 14:00:30.907330 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:30.907056 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" podUID="afacadb4-19ec-4ef4-a556-f38b251c7b81" containerName="maas-api" containerID="cri-o://c669f8506c7918e3c81199826566815055b325536cca1918064931186fb8ce71" gracePeriod=30 Nov 02 14:00:31.077019 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.076988 5081 generic.go:356] "Generic (PLEG): container finished" podID="afacadb4-19ec-4ef4-a556-f38b251c7b81" containerID="c669f8506c7918e3c81199826566815055b325536cca1918064931186fb8ce71" exitCode=0 Nov 02 14:00:31.077199 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.077069 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" event={"ID":"afacadb4-19ec-4ef4-a556-f38b251c7b81","Type":"ContainerDied","Data":"c669f8506c7918e3c81199826566815055b325536cca1918064931186fb8ce71"} Nov 02 14:00:31.324612 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.324581 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 14:00:31.437279 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.437234 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-metrics-certs\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-metrics-certs\") pod \"afacadb4-19ec-4ef4-a556-f38b251c7b81\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " Nov 02 14:00:31.437464 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.437405 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/afacadb4-19ec-4ef4-a556-f38b251c7b81-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afacadb4-19ec-4ef4-a556-f38b251c7b81-openshift-service-ca\") pod \"afacadb4-19ec-4ef4-a556-f38b251c7b81\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " Nov 02 14:00:31.437464 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.437447 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-maas-api-tls\") pod \"afacadb4-19ec-4ef4-a556-f38b251c7b81\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " Nov 02 14:00:31.437588 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.437575 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afacadb4-19ec-4ef4-a556-f38b251c7b81-kube-api-access-55jp6\" (UniqueName: \"kubernetes.io/projected/afacadb4-19ec-4ef4-a556-f38b251c7b81-kube-api-access-55jp6\") pod \"afacadb4-19ec-4ef4-a556-f38b251c7b81\" (UID: \"afacadb4-19ec-4ef4-a556-f38b251c7b81\") " Nov 02 14:00:31.437819 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.437788 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afacadb4-19ec-4ef4-a556-f38b251c7b81-openshift-service-ca" pod "afacadb4-19ec-4ef4-a556-f38b251c7b81" (UID: "afacadb4-19ec-4ef4-a556-f38b251c7b81"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:31.438058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.438038 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/afacadb4-19ec-4ef4-a556-f38b251c7b81-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:31.439498 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.439464 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-metrics-certs" pod "afacadb4-19ec-4ef4-a556-f38b251c7b81" (UID: "afacadb4-19ec-4ef4-a556-f38b251c7b81"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:00:31.439812 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.439792 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afacadb4-19ec-4ef4-a556-f38b251c7b81-kube-api-access-55jp6" pod "afacadb4-19ec-4ef4-a556-f38b251c7b81" (UID: "afacadb4-19ec-4ef4-a556-f38b251c7b81"). InnerVolumeSpecName "kube-api-access-55jp6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:31.439892 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.439876 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-maas-api-tls" pod "afacadb4-19ec-4ef4-a556-f38b251c7b81" (UID: "afacadb4-19ec-4ef4-a556-f38b251c7b81"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:00:31.540087 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.540047 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:31.540087 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.540090 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/afacadb4-19ec-4ef4-a556-f38b251c7b81-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:31.540312 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.540107 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55jp6\" (UniqueName: \"kubernetes.io/projected/afacadb4-19ec-4ef4-a556-f38b251c7b81-kube-api-access-55jp6\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:31.545461 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:31.545361 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" podUID="33df33e4-615f-4113-92ac-55e523b1f4a2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 02 14:00:32.085491 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.085458 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" event={"ID":"afacadb4-19ec-4ef4-a556-f38b251c7b81","Type":"ContainerDied","Data":"62dc83c3396cc4562c9ff721cc05029e2db1353cb589d0d1a3737b1baa8c9106"} Nov 02 14:00:32.086116 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.085525 5081 scope.go:122] "RemoveContainer" containerID="c669f8506c7918e3c81199826566815055b325536cca1918064931186fb8ce71" Nov 02 14:00:32.086116 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.085468 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h" Nov 02 14:00:32.112113 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.112086 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h"] Nov 02 14:00:32.117832 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.117806 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-7a9443-7887867fdf-b864h"] Nov 02 14:00:32.138051 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.138012 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="afacadb4-19ec-4ef4-a556-f38b251c7b81" path="/var/lib/kubelet/pods/afacadb4-19ec-4ef4-a556-f38b251c7b81/volumes" Nov 02 14:00:32.594699 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.594631 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 14:00:32.755327 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.755296 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ce893fe-d5d5-4c55-9a31-d76889d2567e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ce893fe-d5d5-4c55-9a31-d76889d2567e-plugins-config-volume\") pod \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " Nov 02 14:00:32.755502 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.755415 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ce893fe-d5d5-4c55-9a31-d76889d2567e-kube-api-access-d9gq4\" (UniqueName: \"kubernetes.io/projected/4ce893fe-d5d5-4c55-9a31-d76889d2567e-kube-api-access-d9gq4\") pod \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\" (UID: \"4ce893fe-d5d5-4c55-9a31-d76889d2567e\") " Nov 02 14:00:32.755775 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.755748 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ce893fe-d5d5-4c55-9a31-d76889d2567e-plugins-config-volume" pod "4ce893fe-d5d5-4c55-9a31-d76889d2567e" (UID: "4ce893fe-d5d5-4c55-9a31-d76889d2567e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:32.756059 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.756039 5081 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ce893fe-d5d5-4c55-9a31-d76889d2567e-plugins-config-volume\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:32.757706 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.757678 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce893fe-d5d5-4c55-9a31-d76889d2567e-kube-api-access-d9gq4" pod "4ce893fe-d5d5-4c55-9a31-d76889d2567e" (UID: "4ce893fe-d5d5-4c55-9a31-d76889d2567e"). InnerVolumeSpecName "kube-api-access-d9gq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:32.857931 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:32.857845 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9gq4\" (UniqueName: \"kubernetes.io/projected/4ce893fe-d5d5-4c55-9a31-d76889d2567e-kube-api-access-d9gq4\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:33.094480 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.094445 5081 generic.go:356] "Generic (PLEG): container finished" podID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" containerID="ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b" exitCode=0 Nov 02 14:00:33.094908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.094489 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" event={"ID":"4ce893fe-d5d5-4c55-9a31-d76889d2567e","Type":"ContainerDied","Data":"ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b"} Nov 02 14:00:33.094908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.094501 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" Nov 02 14:00:33.094908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.094590 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z" event={"ID":"4ce893fe-d5d5-4c55-9a31-d76889d2567e","Type":"ContainerDied","Data":"349e9fdea7b7711d6ab2f55726296a43efabe576476f292cf49f280dc8405b87"} Nov 02 14:00:33.094908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.094612 5081 scope.go:122] "RemoveContainer" containerID="ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b" Nov 02 14:00:33.105115 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.105093 5081 scope.go:122] "RemoveContainer" containerID="ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b" Nov 02 14:00:33.105408 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:33.105389 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b\": container with ID starting with ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b not found: ID does not exist" containerID="ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b" Nov 02 14:00:33.105470 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.105422 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b"} err="failed to get container status \"ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b\": rpc error: code = NotFound desc = could not find container \"ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b\": container with ID starting with ec44a0aaeb9fb6a6d73c8f71543196031ce6d7b019c94f3d3722363406f4f95b not found: ID does not exist" Nov 02 14:00:33.122920 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.122835 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z"] Nov 02 14:00:33.135575 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:33.135530 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-9e0c2f-5677d978cf-4r56z"] Nov 02 14:00:34.136970 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:34.136936 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" path="/var/lib/kubelet/pods/4ce893fe-d5d5-4c55-9a31-d76889d2567e/volumes" Nov 02 14:00:35.300397 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.300366 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7"] Nov 02 14:00:35.300850 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.300579 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" containerID="cri-o://c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f" gracePeriod=30 Nov 02 14:00:35.307331 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.307303 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq"] Nov 02 14:00:35.307520 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.307486 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" containerID="cri-o://f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc" gracePeriod=30 Nov 02 14:00:35.341101 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.341071 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9"] Nov 02 14:00:35.341278 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.341260 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" containerID="cri-o://ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca" gracePeriod=30 Nov 02 14:00:35.380940 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.380908 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w"] Nov 02 14:00:35.381108 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:35.381090 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" containerID="cri-o://fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63" gracePeriod=30 Nov 02 14:00:38.557171 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:38.557124 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:00:38.612799 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.612761 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj"] Nov 02 14:00:38.820740 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.820713 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 14:00:38.851647 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.851610 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33df33e4-615f-4113-92ac-55e523b1f4a2-kube-api-access-hj25g\" (UniqueName: \"kubernetes.io/projected/33df33e4-615f-4113-92ac-55e523b1f4a2-kube-api-access-hj25g\") pod \"33df33e4-615f-4113-92ac-55e523b1f4a2\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " Nov 02 14:00:38.851816 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.851704 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/33df33e4-615f-4113-92ac-55e523b1f4a2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33df33e4-615f-4113-92ac-55e523b1f4a2-plugins-config-volume\") pod \"33df33e4-615f-4113-92ac-55e523b1f4a2\" (UID: \"33df33e4-615f-4113-92ac-55e523b1f4a2\") " Nov 02 14:00:38.852121 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.852099 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33df33e4-615f-4113-92ac-55e523b1f4a2-plugins-config-volume" pod "33df33e4-615f-4113-92ac-55e523b1f4a2" (UID: "33df33e4-615f-4113-92ac-55e523b1f4a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:38.852391 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.852375 5081 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/33df33e4-615f-4113-92ac-55e523b1f4a2-plugins-config-volume\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:38.853828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.853804 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33df33e4-615f-4113-92ac-55e523b1f4a2-kube-api-access-hj25g" pod "33df33e4-615f-4113-92ac-55e523b1f4a2" (UID: "33df33e4-615f-4113-92ac-55e523b1f4a2"). InnerVolumeSpecName "kube-api-access-hj25g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:38.956406 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:38.956372 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hj25g\" (UniqueName: \"kubernetes.io/projected/33df33e4-615f-4113-92ac-55e523b1f4a2-kube-api-access-hj25g\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:39.142938 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.142855 5081 generic.go:356] "Generic (PLEG): container finished" podID="33df33e4-615f-4113-92ac-55e523b1f4a2" containerID="6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259" exitCode=0 Nov 02 14:00:39.142938 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.142904 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" Nov 02 14:00:39.143169 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.142935 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" event={"ID":"33df33e4-615f-4113-92ac-55e523b1f4a2","Type":"ContainerDied","Data":"6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259"} Nov 02 14:00:39.143169 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.142991 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj" event={"ID":"33df33e4-615f-4113-92ac-55e523b1f4a2","Type":"ContainerDied","Data":"6232f01d9bec425c73aabaeb0d94826b4415e4a0c9248b372b9bb2af78c411e4"} Nov 02 14:00:39.143169 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.143012 5081 scope.go:122] "RemoveContainer" containerID="6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259" Nov 02 14:00:39.153395 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.153378 5081 scope.go:122] "RemoveContainer" containerID="6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259" Nov 02 14:00:39.153743 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:39.153724 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259\": container with ID starting with 6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259 not found: ID does not exist" containerID="6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259" Nov 02 14:00:39.153837 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.153751 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259"} err="failed to get container status \"6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259\": rpc error: code = NotFound desc = could not find container \"6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259\": container with ID starting with 6bbca773f9861459dc0744f6a44aa3d552ee1fbad6abe25df2364aaef0d34259 not found: ID does not exist" Nov 02 14:00:39.169546 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.169510 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj"] Nov 02 14:00:39.176901 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:39.176883 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-7a9443-5556447cd7-wjsjj"] Nov 02 14:00:40.137719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.137690 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="33df33e4-615f-4113-92ac-55e523b1f4a2" path="/var/lib/kubelet/pods/33df33e4-615f-4113-92ac-55e523b1f4a2/volumes" Nov 02 14:00:40.750917 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.750600 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 14:00:40.755018 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.754997 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 14:00:40.768457 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.768434 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 14:00:40.774676 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.774655 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 14:00:40.787910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.787882 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-podinfo\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.788071 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.787929 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-credential-socket\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.788071 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.787963 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istiod-ca-cert\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.788071 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.787999 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-podinfo\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.788071 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788030 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-envoy\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.788300 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788070 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-socket\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.788300 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788099 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4ad76a45-130a-489d-8d24-f6591444324b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad76a45-130a-489d-8d24-f6591444324b-istiod-ca-cert\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.788300 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788151 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-credential-socket\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.788300 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788189 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istiod-ca-cert\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.788300 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788226 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-token\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-token\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.788300 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788264 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-credential-socket\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788304 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-kube-api-access-nr26w\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-kube-api-access-nr26w\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788362 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-envoy\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788404 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-socket\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788441 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-token\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-token\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788468 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-certs\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788509 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-data\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788524 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-credential-socket" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.788625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.788581 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-envoy\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.790705 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.789119 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-credential-socket" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.790705 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.789298 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-socket" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.790705 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.789607 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ad76a45-130a-489d-8d24-f6591444324b-istiod-ca-cert" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:40.790705 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.790150 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-credential-socket" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.790705 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.790474 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istiod-ca-cert" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:40.791682 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.791569 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istiod-ca-cert" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:40.791783 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.791673 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-certs" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.792119 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.792026 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-data" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.793306 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.792614 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4ad76a45-130a-489d-8d24-f6591444324b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad76a45-130a-489d-8d24-f6591444324b-istio-podinfo\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.793306 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.792725 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-socket" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.793306 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.792658 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-certs\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.793306 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793260 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-certs\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.793586 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793330 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-kube-api-access-9jln2\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-kube-api-access-9jln2\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.793586 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793372 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-data\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.793586 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793403 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-data\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.793586 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793445 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istiod-ca-cert\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.793586 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793489 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-data\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.793815 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793590 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-credential-socket\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.793815 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793621 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-envoy\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.793815 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793649 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-kube-api-access-jwb6k\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-kube-api-access-jwb6k\") pod \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\" (UID: \"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd\") " Nov 02 14:00:40.793815 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793711 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-socket\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.793815 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793747 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-podinfo\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.793815 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.793778 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-istio-token\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-istio-token\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.794037 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.794004 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-socket\") pod \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\" (UID: \"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5\") " Nov 02 14:00:40.794071 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.794040 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-token\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-token\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.794113 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.794093 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-certs\") pod \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\" (UID: \"255fbdd1-64c6-4d86-94c1-821afa5d6e19\") " Nov 02 14:00:40.794188 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.794168 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-kube-api-access-rh5sb\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-kube-api-access-rh5sb\") pod \"4ad76a45-130a-489d-8d24-f6591444324b\" (UID: \"4ad76a45-130a-489d-8d24-f6591444324b\") " Nov 02 14:00:40.795001 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.794975 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-credential-socket" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.795097 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795032 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795097 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795057 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795097 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795072 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795097 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795087 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ad76a45-130a-489d-8d24-f6591444324b-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795102 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795119 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795134 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795148 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795152 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-certs" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.795341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795163 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795341 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795176 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.795769 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.795350 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-certs" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.796259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.796042 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-data" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.796259 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.796145 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-data" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.796428 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.796300 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ad76a45-130a-489d-8d24-f6591444324b-istio-podinfo" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:40.796428 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.796356 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istiod-ca-cert" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:40.796656 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.796515 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-data" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.796938 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.796808 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-certs" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.797764 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.797339 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-socket" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.804283 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.802886 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-socket" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.804283 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.802971 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-podinfo" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:40.804283 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.803185 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-envoy" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.804283 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.803289 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-envoy" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.806989 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.806960 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-envoy" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.807156 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.807133 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-kube-api-access-rh5sb" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "kube-api-access-rh5sb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.807944 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.807916 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-kube-api-access-nr26w" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "kube-api-access-nr26w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.810720 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.810292 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-istio-token" pod "4ad76a45-130a-489d-8d24-f6591444324b" (UID: "4ad76a45-130a-489d-8d24-f6591444324b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.811501 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.811448 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-podinfo" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:40.812759 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.812733 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-token" pod "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" (UID: "f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.812910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.812886 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-token" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.814318 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.814286 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-token" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.814463 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.814441 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-podinfo" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:40.815080 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.815058 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-kube-api-access-jwb6k" pod "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" (UID: "5bf1d379-625a-4bdb-881d-cf1e8bf48bfd"). InnerVolumeSpecName "kube-api-access-jwb6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.815170 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.815092 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-kube-api-access-9jln2" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "kube-api-access-9jln2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:40.815696 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.815671 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-envoy" pod "255fbdd1-64c6-4d86-94c1-821afa5d6e19" (UID: "255fbdd1-64c6-4d86-94c1-821afa5d6e19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:40.896158 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896128 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896158 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896153 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896158 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896161 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896170 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr26w\" (UniqueName: \"kubernetes.io/projected/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-kube-api-access-nr26w\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896179 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896190 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896198 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896206 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ad76a45-130a-489d-8d24-f6591444324b-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896215 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896224 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896232 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jln2\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-kube-api-access-9jln2\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896241 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896249 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ad76a45-130a-489d-8d24-f6591444324b-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896258 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896266 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896275 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896283 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896291 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwb6k\" (UniqueName: \"kubernetes.io/projected/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-kube-api-access-jwb6k\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896300 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896308 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896316 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896323 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896331 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/255fbdd1-64c6-4d86-94c1-821afa5d6e19-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896338 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/255fbdd1-64c6-4d86-94c1-821afa5d6e19-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896346 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh5sb\" (UniqueName: \"kubernetes.io/projected/4ad76a45-130a-489d-8d24-f6591444324b-kube-api-access-rh5sb\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.896478 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.896356 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:40.992380 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.992274 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc"] Nov 02 14:00:40.992669 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.992500 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" containerID="cri-o://c9052e6aeaca2781e9a641d516fd501d094f6613b33acc2b4ec6e109a3b5e81b" gracePeriod=30 Nov 02 14:00:40.997236 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.997211 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f"] Nov 02 14:00:40.997442 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:40.997415 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" containerID="cri-o://75edea22dd2ad32db3f853f4a6a39fb23628c8db404e9da4b23bda3aa41708d7" gracePeriod=30 Nov 02 14:00:41.013976 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.013945 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r"] Nov 02 14:00:41.014142 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.014124 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" containerID="cri-o://16a8e3874a55fe606eb8f18d6f551cc712ba0f9f8b8198de3031f2303ae6baf8" gracePeriod=30 Nov 02 14:00:41.168527 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.168490 5081 generic.go:356] "Generic (PLEG): container finished" podID="4ad76a45-130a-489d-8d24-f6591444324b" containerID="ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca" exitCode=0 Nov 02 14:00:41.168970 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.168643 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" event={"ID":"4ad76a45-130a-489d-8d24-f6591444324b","Type":"ContainerDied","Data":"ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca"} Nov 02 14:00:41.168970 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.168684 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" event={"ID":"4ad76a45-130a-489d-8d24-f6591444324b","Type":"ContainerDied","Data":"116c7baf7e35f5f9ffcfa83445edec0db896271250494b3fbe2795fd13c53a17"} Nov 02 14:00:41.168970 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.168704 5081 scope.go:122] "RemoveContainer" containerID="ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca" Nov 02 14:00:41.168970 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.168822 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9" Nov 02 14:00:41.173395 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.173361 5081 generic.go:356] "Generic (PLEG): container finished" podID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerID="fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63" exitCode=0 Nov 02 14:00:41.173736 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.173708 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" event={"ID":"255fbdd1-64c6-4d86-94c1-821afa5d6e19","Type":"ContainerDied","Data":"fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63"} Nov 02 14:00:41.173957 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.173922 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" event={"ID":"255fbdd1-64c6-4d86-94c1-821afa5d6e19","Type":"ContainerDied","Data":"89fe703be3c774e85a03cf96576a3bffb5be396f3bba0976adf07b5f682e70c8"} Nov 02 14:00:41.174157 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.174140 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w" Nov 02 14:00:41.179038 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.178995 5081 generic.go:356] "Generic (PLEG): container finished" podID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerID="c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f" exitCode=0 Nov 02 14:00:41.179181 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.179069 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" Nov 02 14:00:41.179181 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.179074 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" event={"ID":"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5","Type":"ContainerDied","Data":"c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f"} Nov 02 14:00:41.179181 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.179151 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7" event={"ID":"f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5","Type":"ContainerDied","Data":"b59a0b2e45acf245bbd55df76f952b15ac18ea54325715a1fa0ad5731f1dcaea"} Nov 02 14:00:41.184781 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.184752 5081 generic.go:356] "Generic (PLEG): container finished" podID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerID="f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc" exitCode=0 Nov 02 14:00:41.184948 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.184928 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" event={"ID":"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd","Type":"ContainerDied","Data":"f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc"} Nov 02 14:00:41.185390 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.185362 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" event={"ID":"5bf1d379-625a-4bdb-881d-cf1e8bf48bfd","Type":"ContainerDied","Data":"610719738bd22f3920a01d976d0beeec50f66de662aca397491b7e079e83cb7e"} Nov 02 14:00:41.185498 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.185197 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq" Nov 02 14:00:41.188314 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.188293 5081 scope.go:122] "RemoveContainer" containerID="ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca" Nov 02 14:00:41.189390 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:41.189366 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca\": container with ID starting with ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca not found: ID does not exist" containerID="ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca" Nov 02 14:00:41.189484 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.189396 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca"} err="failed to get container status \"ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca\": rpc error: code = NotFound desc = could not find container \"ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca\": container with ID starting with ca4cbaa62139c651af4ec8158195e17a50f67a37e310d0c92a2bf683e42728ca not found: ID does not exist" Nov 02 14:00:41.189484 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.189412 5081 scope.go:122] "RemoveContainer" containerID="fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63" Nov 02 14:00:41.200007 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.199991 5081 scope.go:122] "RemoveContainer" containerID="fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63" Nov 02 14:00:41.200269 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:41.200251 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63\": container with ID starting with fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63 not found: ID does not exist" containerID="fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63" Nov 02 14:00:41.200331 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.200273 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63"} err="failed to get container status \"fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63\": rpc error: code = NotFound desc = could not find container \"fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63\": container with ID starting with fcc1394f65eac3f7f4851f95a9107860046f52eae64a276919ea9c9ceebe1d63 not found: ID does not exist" Nov 02 14:00:41.200331 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.200289 5081 scope.go:122] "RemoveContainer" containerID="c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f" Nov 02 14:00:41.210455 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.210438 5081 scope.go:122] "RemoveContainer" containerID="c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f" Nov 02 14:00:41.210785 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:41.210766 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f\": container with ID starting with c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f not found: ID does not exist" containerID="c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f" Nov 02 14:00:41.210843 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.210793 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f"} err="failed to get container status \"c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f\": rpc error: code = NotFound desc = could not find container \"c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f\": container with ID starting with c475577bfa32b5af4aa0f3ebcc67380e8a65c882e4174952bc6f0c00454eed7f not found: ID does not exist" Nov 02 14:00:41.210843 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.210810 5081 scope.go:122] "RemoveContainer" containerID="f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc" Nov 02 14:00:41.210956 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.210895 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9"] Nov 02 14:00:41.219870 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.219851 5081 scope.go:122] "RemoveContainer" containerID="f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc" Nov 02 14:00:41.220128 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:00:41.220110 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc\": container with ID starting with f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc not found: ID does not exist" containerID="f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc" Nov 02 14:00:41.220196 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.220134 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc"} err="failed to get container status \"f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc\": rpc error: code = NotFound desc = could not find container \"f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc\": container with ID starting with f47e9ef867877dd7ec88c829d54b03f8abbcceaf1c8e11e43a7f32123b2844fc not found: ID does not exist" Nov 02 14:00:41.229194 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.229172 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-jzmr9"] Nov 02 14:00:41.248286 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.248224 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w"] Nov 02 14:00:41.256578 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.256553 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-62w8w"] Nov 02 14:00:41.269739 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.269718 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7"] Nov 02 14:00:41.278071 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.278047 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-qnnw7"] Nov 02 14:00:41.290550 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.290501 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq"] Nov 02 14:00:41.293039 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:41.293019 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-9e0c2f-openshift-default-55ccb4cb79-k8chq"] Nov 02 14:00:42.137459 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:42.137426 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" path="/var/lib/kubelet/pods/255fbdd1-64c6-4d86-94c1-821afa5d6e19/volumes" Nov 02 14:00:42.138016 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:42.137992 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4ad76a45-130a-489d-8d24-f6591444324b" path="/var/lib/kubelet/pods/4ad76a45-130a-489d-8d24-f6591444324b/volumes" Nov 02 14:00:42.138442 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:42.138426 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" path="/var/lib/kubelet/pods/5bf1d379-625a-4bdb-881d-cf1e8bf48bfd/volumes" Nov 02 14:00:42.139175 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:42.139157 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" path="/var/lib/kubelet/pods/f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5/volumes" Nov 02 14:00:43.613949 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:43.613886 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" podUID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" containerName="payload-pre-processing" containerID="cri-o://e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc" gracePeriod=25 Nov 02 14:00:43.918121 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:43.918091 5081 patch_prober.go:29] interesting pod/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Nov 02 14:00:43.918284 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:43.918149 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Nov 02 14:00:46.239574 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.239061 5081 generic.go:356] "Generic (PLEG): container finished" podID="482197d0-d58c-4b66-8b51-54479f513872" containerID="c9052e6aeaca2781e9a641d516fd501d094f6613b33acc2b4ec6e109a3b5e81b" exitCode=0 Nov 02 14:00:46.239574 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.239133 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" event={"ID":"482197d0-d58c-4b66-8b51-54479f513872","Type":"ContainerDied","Data":"c9052e6aeaca2781e9a641d516fd501d094f6613b33acc2b4ec6e109a3b5e81b"} Nov 02 14:00:46.239574 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.239204 5081 scope.go:122] "RemoveContainer" containerID="01a6428a0e44bfb9ee4d53ead2bd62a6d683508362142207a3abb11825dc3650" Nov 02 14:00:46.241311 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.241283 5081 generic.go:356] "Generic (PLEG): container finished" podID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerID="75edea22dd2ad32db3f853f4a6a39fb23628c8db404e9da4b23bda3aa41708d7" exitCode=0 Nov 02 14:00:46.241444 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.241425 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" event={"ID":"49b57ce4-647b-4e78-ba2b-67853d9d905a","Type":"ContainerDied","Data":"75edea22dd2ad32db3f853f4a6a39fb23628c8db404e9da4b23bda3aa41708d7"} Nov 02 14:00:46.243258 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.243236 5081 generic.go:356] "Generic (PLEG): container finished" podID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerID="16a8e3874a55fe606eb8f18d6f551cc712ba0f9f8b8198de3031f2303ae6baf8" exitCode=0 Nov 02 14:00:46.243342 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.243264 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" event={"ID":"50c49511-9a94-4bfe-86fd-22fcfaac6437","Type":"ContainerDied","Data":"16a8e3874a55fe606eb8f18d6f551cc712ba0f9f8b8198de3031f2303ae6baf8"} Nov 02 14:00:46.309618 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.308770 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 14:00:46.338409 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.338381 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 14:00:46.369873 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.369839 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 14:00:46.372778 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.372750 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-data\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.372909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.372822 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-istio-token\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-istio-token\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.372909 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.372876 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-socket\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.373094 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.372919 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-kube-api-access-hcdmv\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-kube-api-access-hcdmv\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.373094 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.372983 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/482197d0-d58c-4b66-8b51-54479f513872-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482197d0-d58c-4b66-8b51-54479f513872-istio-podinfo\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.373094 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.373017 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/482197d0-d58c-4b66-8b51-54479f513872-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482197d0-d58c-4b66-8b51-54479f513872-istiod-ca-cert\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.373265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.373091 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-credential-socket\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.373265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.373135 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-envoy\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.373265 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.373228 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-certs\") pod \"482197d0-d58c-4b66-8b51-54479f513872\" (UID: \"482197d0-d58c-4b66-8b51-54479f513872\") " Nov 02 14:00:46.373743 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.373467 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-socket" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.374119 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.373931 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-credential-socket" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.379262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.374419 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.379262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.374444 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.379262 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.379198 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/482197d0-d58c-4b66-8b51-54479f513872-istiod-ca-cert" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:46.379466 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.379414 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-envoy" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.379791 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.379618 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-certs" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.379791 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.379705 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-data" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.382135 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.381711 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/482197d0-d58c-4b66-8b51-54479f513872-istio-podinfo" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:46.382135 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.381716 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-istio-token" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:46.383266 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.383244 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-kube-api-access-hcdmv" pod "482197d0-d58c-4b66-8b51-54479f513872" (UID: "482197d0-d58c-4b66-8b51-54479f513872"). InnerVolumeSpecName "kube-api-access-hcdmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:46.475365 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475337 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-envoy\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.475573 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475382 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-podinfo\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.475573 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475422 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-certs\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.475573 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475454 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-credential-socket\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.475573 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475493 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-certs\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.475573 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475525 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-token\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-token\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.475861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475591 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-podinfo\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.475861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475628 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-token\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-token\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.475861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475664 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-data\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.475861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475703 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-kube-api-access-7qkxr\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-kube-api-access-7qkxr\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.475861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475758 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49b57ce4-647b-4e78-ba2b-67853d9d905a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b57ce4-647b-4e78-ba2b-67853d9d905a-istiod-ca-cert\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.475861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475803 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-socket\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.476152 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475916 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-envoy\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.476152 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.475977 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50c49511-9a94-4bfe-86fd-22fcfaac6437-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c49511-9a94-4bfe-86fd-22fcfaac6437-istiod-ca-cert\") pod \"50c49511-9a94-4bfe-86fd-22fcfaac6437\" (UID: \"50c49511-9a94-4bfe-86fd-22fcfaac6437\") " Nov 02 14:00:46.476152 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476045 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-kube-api-access-m9w69\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-kube-api-access-m9w69\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.476152 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476079 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-data\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.476152 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476090 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-credential-socket" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.476384 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476164 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-credential-socket\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.476384 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476207 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-socket\") pod \"49b57ce4-647b-4e78-ba2b-67853d9d905a\" (UID: \"49b57ce4-647b-4e78-ba2b-67853d9d905a\") " Nov 02 14:00:46.476669 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476643 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-certs" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.476756 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476713 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476756 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476735 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476756 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476747 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476761 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcdmv\" (UniqueName: \"kubernetes.io/projected/482197d0-d58c-4b66-8b51-54479f513872-kube-api-access-hcdmv\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476776 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476790 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/482197d0-d58c-4b66-8b51-54479f513872-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476805 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/482197d0-d58c-4b66-8b51-54479f513872-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476819 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/482197d0-d58c-4b66-8b51-54479f513872-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.476908 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.476839 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-socket" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.477213 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.477117 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-certs" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.477522 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.477343 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-data" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.478171 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.477901 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50c49511-9a94-4bfe-86fd-22fcfaac6437-istiod-ca-cert" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:46.478266 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.478224 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-envoy" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.478475 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.478396 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-podinfo" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:46.478475 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.478432 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-credential-socket" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.479339 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.478634 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-data" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.479339 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.478652 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-socket" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.479920 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.479895 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49b57ce4-647b-4e78-ba2b-67853d9d905a-istiod-ca-cert" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:00:46.480845 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.480825 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-kube-api-access-7qkxr" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "kube-api-access-7qkxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:46.481173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.481154 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-token" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:46.481778 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.481755 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-envoy" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:00:46.481893 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.481779 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-kube-api-access-m9w69" pod "49b57ce4-647b-4e78-ba2b-67853d9d905a" (UID: "49b57ce4-647b-4e78-ba2b-67853d9d905a"). InnerVolumeSpecName "kube-api-access-m9w69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:46.481965 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.481942 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-token" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:00:46.483095 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.483077 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-podinfo" pod "50c49511-9a94-4bfe-86fd-22fcfaac6437" (UID: "50c49511-9a94-4bfe-86fd-22fcfaac6437"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:00:46.578231 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578155 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9w69\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-kube-api-access-m9w69\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578231 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578184 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578231 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578199 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578231 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578208 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578231 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578217 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578231 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578224 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578231 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578232 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578240 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578250 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578257 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578272 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578283 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578291 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qkxr\" (UniqueName: \"kubernetes.io/projected/50c49511-9a94-4bfe-86fd-22fcfaac6437-kube-api-access-7qkxr\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578300 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b57ce4-647b-4e78-ba2b-67853d9d905a-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578308 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50c49511-9a94-4bfe-86fd-22fcfaac6437-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578316 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b57ce4-647b-4e78-ba2b-67853d9d905a-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:46.578566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:46.578324 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50c49511-9a94-4bfe-86fd-22fcfaac6437-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:00:47.250170 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.250144 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" Nov 02 14:00:47.250658 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.250169 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc" event={"ID":"482197d0-d58c-4b66-8b51-54479f513872","Type":"ContainerDied","Data":"dff751a649bd3a4dd93c8f3d7afd1e92e4104d4a7158196db52dff5c07cb1fc4"} Nov 02 14:00:47.250658 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.250232 5081 scope.go:122] "RemoveContainer" containerID="c9052e6aeaca2781e9a641d516fd501d094f6613b33acc2b4ec6e109a3b5e81b" Nov 02 14:00:47.251843 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.251815 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" Nov 02 14:00:47.251938 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.251857 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f" event={"ID":"49b57ce4-647b-4e78-ba2b-67853d9d905a","Type":"ContainerDied","Data":"925cb56b71c2b3274515f626cd452f529788b936f136890c006f164d22f54d6a"} Nov 02 14:00:47.253460 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.253431 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" Nov 02 14:00:47.253593 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.253459 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r" event={"ID":"50c49511-9a94-4bfe-86fd-22fcfaac6437","Type":"ContainerDied","Data":"75b98542f5f67d55da421f4eca7be85567e4012c47855ae853ca476fb6a0a078"} Nov 02 14:00:47.261990 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.261970 5081 scope.go:122] "RemoveContainer" containerID="75edea22dd2ad32db3f853f4a6a39fb23628c8db404e9da4b23bda3aa41708d7" Nov 02 14:00:47.271956 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.271940 5081 scope.go:122] "RemoveContainer" containerID="16a8e3874a55fe606eb8f18d6f551cc712ba0f9f8b8198de3031f2303ae6baf8" Nov 02 14:00:47.330093 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.330062 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r"] Nov 02 14:00:47.336429 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.336401 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-kp72r"] Nov 02 14:00:47.373408 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.373368 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc"] Nov 02 14:00:47.392003 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.391973 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-gnddc"] Nov 02 14:00:47.445757 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.445727 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f"] Nov 02 14:00:47.448230 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:47.448207 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7a9443-openshift-default-67958d446f-79s6f"] Nov 02 14:00:48.136902 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:48.136874 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="482197d0-d58c-4b66-8b51-54479f513872" path="/var/lib/kubelet/pods/482197d0-d58c-4b66-8b51-54479f513872/volumes" Nov 02 14:00:48.137347 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:48.137334 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" path="/var/lib/kubelet/pods/49b57ce4-647b-4e78-ba2b-67853d9d905a/volumes" Nov 02 14:00:48.139561 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:48.138356 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" path="/var/lib/kubelet/pods/50c49511-9a94-4bfe-86fd-22fcfaac6437/volumes" Nov 02 14:00:50.356362 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:50.356319 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:00:52.558731 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:52.558685 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" podUID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 02 14:00:58.255650 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:00:58.255560 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:01:02.549516 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:02.549468 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" podUID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")" Nov 02 14:01:03.014048 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.014015 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf"] Nov 02 14:01:03.014313 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.014284 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" containerID="cri-o://3e3331aa927ddf088351d16a0869cf245a61452062df3c9767bcae0f3b9de983" gracePeriod=30 Nov 02 14:01:03.036622 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.036565 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2"] Nov 02 14:01:03.036849 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.036804 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" containerID="cri-o://1d77b7ce1515cc4696d232accab9de9ada111ba34fb38eb5077b26c148084bb4" gracePeriod=30 Nov 02 14:01:03.042467 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.042441 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb"] Nov 02 14:01:03.042718 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.042694 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" containerID="cri-o://fd53d43fd67ac9839d5d580529c20eeec7625358614b3fef57592cd240eae909" gracePeriod=30 Nov 02 14:01:03.044686 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.044666 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9"] Nov 02 14:01:03.044860 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.044826 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" containerID="cri-o://e7a5cec16d5c4f79702113ca37b5d8a0426e9de0c477688cbfa3b197cdb20d9c" gracePeriod=30 Nov 02 14:01:03.895415 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.895382 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 14:01:03.906845 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.906820 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-plugins-config-volume\") pod \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " Nov 02 14:01:03.906959 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.906854 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-kube-api-access-fnr5p\" (UniqueName: \"kubernetes.io/projected/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-kube-api-access-fnr5p\") pod \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\" (UID: \"741f4b41-95c3-46d3-9951-8cb43f2c1b9e\") " Nov 02 14:01:03.907235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.907211 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-plugins-config-volume" pod "741f4b41-95c3-46d3-9951-8cb43f2c1b9e" (UID: "741f4b41-95c3-46d3-9951-8cb43f2c1b9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:01:03.907375 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.907360 5081 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-plugins-config-volume\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:03.909098 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:03.909075 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-kube-api-access-fnr5p" pod "741f4b41-95c3-46d3-9951-8cb43f2c1b9e" (UID: "741f4b41-95c3-46d3-9951-8cb43f2c1b9e"). InnerVolumeSpecName "kube-api-access-fnr5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:04.008360 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.008329 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnr5p\" (UniqueName: \"kubernetes.io/projected/741f4b41-95c3-46d3-9951-8cb43f2c1b9e-kube-api-access-fnr5p\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:04.385031 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.384994 5081 generic.go:356] "Generic (PLEG): container finished" podID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" containerID="e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc" exitCode=0 Nov 02 14:01:04.385191 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.385037 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" Nov 02 14:01:04.385191 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.385041 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" event={"ID":"741f4b41-95c3-46d3-9951-8cb43f2c1b9e","Type":"ContainerDied","Data":"e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc"} Nov 02 14:01:04.385191 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.385095 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj" event={"ID":"741f4b41-95c3-46d3-9951-8cb43f2c1b9e","Type":"ContainerDied","Data":"d97bb87875e6967613b5ead6843c381b4aad064bf2668b9678dd59423c4c1901"} Nov 02 14:01:04.385191 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.385125 5081 scope.go:122] "RemoveContainer" containerID="e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc" Nov 02 14:01:04.394719 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.394697 5081 scope.go:122] "RemoveContainer" containerID="e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc" Nov 02 14:01:04.394965 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:01:04.394948 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc\": container with ID starting with e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc not found: ID does not exist" containerID="e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc" Nov 02 14:01:04.395024 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.394973 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc"} err="failed to get container status \"e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc\": rpc error: code = NotFound desc = could not find container \"e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc\": container with ID starting with e699037671627e01f24e35812cde543c13318e3ce503d9951162041a130b9bbc not found: ID does not exist" Nov 02 14:01:04.403706 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.403686 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj"] Nov 02 14:01:04.408362 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:04.408336 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w2-ee7df2-7b94c8dc5f-pkgxj"] Nov 02 14:01:06.137625 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:06.137590 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" path="/var/lib/kubelet/pods/741f4b41-95c3-46d3-9951-8cb43f2c1b9e/volumes" Nov 02 14:01:08.211695 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.207706 5081 patch_prober.go:29] interesting pod/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Nov 02 14:01:08.211695 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.207787 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Nov 02 14:01:08.482218 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.482022 5081 generic.go:356] "Generic (PLEG): container finished" podID="30bfddcb-5159-478f-9763-e04eca085914" containerID="e7a5cec16d5c4f79702113ca37b5d8a0426e9de0c477688cbfa3b197cdb20d9c" exitCode=0 Nov 02 14:01:08.482218 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.482117 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" event={"ID":"30bfddcb-5159-478f-9763-e04eca085914","Type":"ContainerDied","Data":"e7a5cec16d5c4f79702113ca37b5d8a0426e9de0c477688cbfa3b197cdb20d9c"} Nov 02 14:01:08.491218 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.491031 5081 generic.go:356] "Generic (PLEG): container finished" podID="76673f96-b245-4c84-af4e-8926e7a32211" containerID="fd53d43fd67ac9839d5d580529c20eeec7625358614b3fef57592cd240eae909" exitCode=0 Nov 02 14:01:08.491218 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.491133 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" event={"ID":"76673f96-b245-4c84-af4e-8926e7a32211","Type":"ContainerDied","Data":"fd53d43fd67ac9839d5d580529c20eeec7625358614b3fef57592cd240eae909"} Nov 02 14:01:08.521640 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.521208 5081 generic.go:356] "Generic (PLEG): container finished" podID="a482589f-cadc-4514-9380-8476579441b3" containerID="1d77b7ce1515cc4696d232accab9de9ada111ba34fb38eb5077b26c148084bb4" exitCode=0 Nov 02 14:01:08.521640 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.521420 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" event={"ID":"a482589f-cadc-4514-9380-8476579441b3","Type":"ContainerDied","Data":"1d77b7ce1515cc4696d232accab9de9ada111ba34fb38eb5077b26c148084bb4"} Nov 02 14:01:08.521640 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.521482 5081 scope.go:122] "RemoveContainer" containerID="2bf9ba3147931b8f516fe15040c34d75e3e18b61b6e47fea9fb9284722db46e0" Nov 02 14:01:08.554690 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.554394 5081 generic.go:356] "Generic (PLEG): container finished" podID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerID="3e3331aa927ddf088351d16a0869cf245a61452062df3c9767bcae0f3b9de983" exitCode=0 Nov 02 14:01:08.554690 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:08.554492 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" event={"ID":"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb","Type":"ContainerDied","Data":"3e3331aa927ddf088351d16a0869cf245a61452062df3c9767bcae0f3b9de983"} Nov 02 14:01:08.778006 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:01:08.777931 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:01:10.046098 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.046065 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 14:01:10.051491 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.051432 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 14:01:10.056734 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.056710 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 14:01:10.067736 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.067711 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 14:01:10.143996 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.143964 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-credential-socket\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.144199 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144008 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istiod-ca-cert\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.144199 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144041 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-socket\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.144199 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144157 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-kube-api-access-ntdtm\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-kube-api-access-ntdtm\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.144387 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144201 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-data\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.144387 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144239 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-data\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.144387 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144268 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-token\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-token\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.144387 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144316 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-socket" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.144658 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144393 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istiod-ca-cert" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:01:10.144658 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144327 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-credential-socket\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.144658 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144611 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-data" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.144832 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144811 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-kube-api-access-xzv54\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-kube-api-access-xzv54\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.144893 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144868 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-socket\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.144893 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144871 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-credential-socket" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.144999 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144899 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-envoy\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.144999 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144930 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-data\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.144999 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.144957 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-envoy\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.145160 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145019 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-envoy\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.145160 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145060 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-podinfo\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.145160 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145077 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-data" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.145160 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145094 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-certs\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.145160 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145126 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-credential-socket\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.145160 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145158 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-socket\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145186 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-data\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145222 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76673f96-b245-4c84-af4e-8926e7a32211-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76673f96-b245-4c84-af4e-8926e7a32211-istiod-ca-cert\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145256 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-istio-token\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-istio-token\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145301 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-kube-api-access-nldtf\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-kube-api-access-nldtf\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145332 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-kube-api-access-lng94\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-kube-api-access-lng94\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145357 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/76673f96-b245-4c84-af4e-8926e7a32211-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76673f96-b245-4c84-af4e-8926e7a32211-istio-podinfo\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145362 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-socket" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145393 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-envoy\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145431 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-certs\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145476 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-istio-token\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-istio-token\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145512 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/30bfddcb-5159-478f-9763-e04eca085914-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bfddcb-5159-478f-9763-e04eca085914-istio-podinfo\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145566 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-socket\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145582 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-socket" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145632 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a482589f-cadc-4514-9380-8476579441b3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a482589f-cadc-4514-9380-8476579441b3-istio-podinfo\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145683 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-certs\") pod \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\" (UID: \"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145746 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-certs\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145792 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-istio-token\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-istio-token\") pod \"76673f96-b245-4c84-af4e-8926e7a32211\" (UID: \"76673f96-b245-4c84-af4e-8926e7a32211\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145853 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-credential-socket\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145865 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-credential-socket" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145905 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30bfddcb-5159-478f-9763-e04eca085914-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bfddcb-5159-478f-9763-e04eca085914-istiod-ca-cert\") pod \"30bfddcb-5159-478f-9763-e04eca085914\" (UID: \"30bfddcb-5159-478f-9763-e04eca085914\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.145942 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a482589f-cadc-4514-9380-8476579441b3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a482589f-cadc-4514-9380-8476579441b3-istiod-ca-cert\") pod \"a482589f-cadc-4514-9380-8476579441b3\" (UID: \"a482589f-cadc-4514-9380-8476579441b3\") " Nov 02 14:01:10.146110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.146085 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-certs" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.146924 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.146948 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.146963 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.146980 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.146994 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147019 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147031 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147206 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147218 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-token" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.147301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147248 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.147789 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147518 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-kube-api-access-ntdtm" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "kube-api-access-ntdtm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.147789 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147556 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-credential-socket" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.147789 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147624 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a482589f-cadc-4514-9380-8476579441b3-istiod-ca-cert" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:01:10.147789 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147732 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-data" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.147789 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.147778 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-certs" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.148044 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.148020 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-certs" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.150290 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.148702 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-kube-api-access-xzv54" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "kube-api-access-xzv54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.150290 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.150202 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-istio-token" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.150648 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.150620 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30bfddcb-5159-478f-9763-e04eca085914-istio-podinfo" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:01:10.150978 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.150844 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-socket" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.151066 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151044 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-podinfo" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:01:10.151145 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151121 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-kube-api-access-nldtf" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "kube-api-access-nldtf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.151207 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151180 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-data" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.151207 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151185 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-envoy" pod "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" (UID: "2fdcc35a-e07d-482b-a45e-0b5143ce4cfb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.151320 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151231 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-envoy" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.151477 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151454 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-credential-socket" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.151696 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151672 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76673f96-b245-4c84-af4e-8926e7a32211-istiod-ca-cert" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:01:10.152275 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151922 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76673f96-b245-4c84-af4e-8926e7a32211-istio-podinfo" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:01:10.152275 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.151938 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-certs" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.152275 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.152218 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-envoy" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.152275 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.152247 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30bfddcb-5159-478f-9763-e04eca085914-istiod-ca-cert" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:01:10.152842 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.152821 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-istio-token" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.152959 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.152891 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-envoy" pod "30bfddcb-5159-478f-9763-e04eca085914" (UID: "30bfddcb-5159-478f-9763-e04eca085914"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:01:10.153414 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.153391 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a482589f-cadc-4514-9380-8476579441b3-istio-podinfo" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Nov 02 14:01:10.153980 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.153954 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-kube-api-access-lng94" pod "76673f96-b245-4c84-af4e-8926e7a32211" (UID: "76673f96-b245-4c84-af4e-8926e7a32211"). InnerVolumeSpecName "kube-api-access-lng94". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.154919 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.154897 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-istio-token" pod "a482589f-cadc-4514-9380-8476579441b3" (UID: "a482589f-cadc-4514-9380-8476579441b3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:01:10.248411 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248320 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248411 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248351 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30bfddcb-5159-478f-9763-e04eca085914-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248411 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248364 5081 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248411 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248378 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a482589f-cadc-4514-9380-8476579441b3-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248411 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248390 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248411 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248402 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248416 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248431 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248443 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30bfddcb-5159-478f-9763-e04eca085914-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248456 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a482589f-cadc-4514-9380-8476579441b3-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248467 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntdtm\" (UniqueName: \"kubernetes.io/projected/30bfddcb-5159-478f-9763-e04eca085914-kube-api-access-ntdtm\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248479 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248491 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzv54\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-kube-api-access-xzv54\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248503 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248517 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248529 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a482589f-cadc-4514-9380-8476579441b3-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248574 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76673f96-b245-4c84-af4e-8926e7a32211-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248588 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248599 5081 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-credential-socket\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248611 5081 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-data\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248623 5081 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76673f96-b245-4c84-af4e-8926e7a32211-istiod-ca-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248635 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a482589f-cadc-4514-9380-8476579441b3-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248649 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nldtf\" (UniqueName: \"kubernetes.io/projected/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb-kube-api-access-nldtf\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248665 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lng94\" (UniqueName: \"kubernetes.io/projected/76673f96-b245-4c84-af4e-8926e7a32211-kube-api-access-lng94\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248679 5081 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76673f96-b245-4c84-af4e-8926e7a32211-istio-podinfo\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248692 5081 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-istio-envoy\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.248828 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.248707 5081 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30bfddcb-5159-478f-9763-e04eca085914-workload-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:01:10.661418 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.661391 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" Nov 02 14:01:10.661634 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.661383 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9" event={"ID":"30bfddcb-5159-478f-9763-e04eca085914","Type":"ContainerDied","Data":"0270f2fc95fc2f70319b427b1f9d1c4a6cab402e0fafbaa9177d63ff79f27b67"} Nov 02 14:01:10.661634 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.661555 5081 scope.go:122] "RemoveContainer" containerID="e7a5cec16d5c4f79702113ca37b5d8a0426e9de0c477688cbfa3b197cdb20d9c" Nov 02 14:01:10.662993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.662973 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" Nov 02 14:01:10.662993 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.662982 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb" event={"ID":"76673f96-b245-4c84-af4e-8926e7a32211","Type":"ContainerDied","Data":"b3d318e3c23dd25629a413f049cd4f3e009c5b7e9aeee2a0920e8979c56ee922"} Nov 02 14:01:10.664312 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.664291 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" event={"ID":"a482589f-cadc-4514-9380-8476579441b3","Type":"ContainerDied","Data":"9cc51b07cf2ecee43467bf7d3cd0e7d2d8cd2491f51de225d1b5ae1e592a6ecd"} Nov 02 14:01:10.664420 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.664376 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2" Nov 02 14:01:10.671893 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.671878 5081 scope.go:122] "RemoveContainer" containerID="fd53d43fd67ac9839d5d580529c20eeec7625358614b3fef57592cd240eae909" Nov 02 14:01:10.672916 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.672896 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" event={"ID":"2fdcc35a-e07d-482b-a45e-0b5143ce4cfb","Type":"ContainerDied","Data":"544ba2aa4141743c62f931ee0eb790960e4c8376ad13e0384e130f16bfd30057"} Nov 02 14:01:10.672994 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.672907 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf" Nov 02 14:01:10.682757 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.682736 5081 scope.go:122] "RemoveContainer" containerID="1d77b7ce1515cc4696d232accab9de9ada111ba34fb38eb5077b26c148084bb4" Nov 02 14:01:10.691384 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.691366 5081 scope.go:122] "RemoveContainer" containerID="3e3331aa927ddf088351d16a0869cf245a61452062df3c9767bcae0f3b9de983" Nov 02 14:01:10.698407 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.698386 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2"] Nov 02 14:01:10.704040 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.704019 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-n6hq2"] Nov 02 14:01:10.720337 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.720317 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb"] Nov 02 14:01:10.724943 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.724920 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-nrgmb"] Nov 02 14:01:10.736449 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.736427 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf"] Nov 02 14:01:10.741352 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.741331 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-jzmqf"] Nov 02 14:01:10.755691 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.755666 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9"] Nov 02 14:01:10.762825 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:10.762800 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-ee7df2-openshift-default-d9ffd98dc-lzff9"] Nov 02 14:01:12.137284 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:12.137249 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" path="/var/lib/kubelet/pods/2fdcc35a-e07d-482b-a45e-0b5143ce4cfb/volumes" Nov 02 14:01:12.137758 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:12.137742 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30bfddcb-5159-478f-9763-e04eca085914" path="/var/lib/kubelet/pods/30bfddcb-5159-478f-9763-e04eca085914/volumes" Nov 02 14:01:12.138173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:12.138156 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76673f96-b245-4c84-af4e-8926e7a32211" path="/var/lib/kubelet/pods/76673f96-b245-4c84-af4e-8926e7a32211/volumes" Nov 02 14:01:12.138989 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:01:12.138970 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a482589f-cadc-4514-9380-8476579441b3" path="/var/lib/kubelet/pods/a482589f-cadc-4514-9380-8476579441b3/volumes" Nov 02 14:01:38.555698 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:01:38.555647 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:02:03.026383 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:02:03.026352 5081 scope.go:122] "RemoveContainer" containerID="4906557d7d67f9e32d82b7738b148994383d3460f37a065e3f5f8dbbdfc11f2e" Nov 02 14:02:08.556302 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:02:08.556255 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:02:20.523559 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:02:20.523508 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:02:38.558137 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:02:38.558099 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:02:45.714090 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:02:45.714045 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:02:49.872387 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:02:49.872351 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:03:04.530015 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:03:04.529982 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:03:04.542807 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:03:04.542786 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:03:06.557959 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:03:06.557920 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:03:08.557049 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:03:08.557015 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:03:19.521775 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:03:19.521685 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:03:38.555675 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:03:38.555624 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:03:43.812842 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:03:43.812810 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:03:54.051884 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:03:54.051843 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:03:59.150581 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:03:59.150518 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:04:08.556023 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:04:08.555983 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:04:15.027902 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:04:15.027862 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:04:18.983359 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:04:18.983267 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:04:33.147441 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:04:33.147407 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:04:38.578562 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:04:38.578463 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:04:38.725642 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:04:38.724090 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:04:52.004516 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:04:52.004434 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:05:04.729093 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:04.729050 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:05:08.555528 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:05:08.555490 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:05:18.732167 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:18.732125 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:05:29.345632 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:29.345590 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:05:33.892565 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:33.888731 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:05:38.556417 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:05:38.556381 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:05:50.644746 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:50.644709 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:05:54.217328 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:54.217297 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:05:57.370235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.370196 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr"] Nov 02 14:05:57.370670 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.370409 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" podUID="002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" containerName="discovery" containerID="cri-o://ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a" gracePeriod=30 Nov 02 14:05:57.633904 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.633847 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 14:05:57.692508 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.692469 5081 generic.go:356] "Generic (PLEG): container finished" podID="002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" containerID="ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a" exitCode=0 Nov 02 14:05:57.692700 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.692523 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" Nov 02 14:05:57.692700 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.692522 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" event={"ID":"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08","Type":"ContainerDied","Data":"ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a"} Nov 02 14:05:57.692700 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.692624 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr" event={"ID":"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08","Type":"ContainerDied","Data":"7a65928ac74a39f929f9db7dfbca7b9ab841c663e7a94b8a04237d64e7978669"} Nov 02 14:05:57.692700 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.692656 5081 scope.go:122] "RemoveContainer" containerID="ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a" Nov 02 14:05:57.702903 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.702885 5081 scope.go:122] "RemoveContainer" containerID="ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a" Nov 02 14:05:57.703184 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:05:57.703165 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a\": container with ID starting with ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a not found: ID does not exist" containerID="ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a" Nov 02 14:05:57.703228 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.703194 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a"} err="failed to get container status \"ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a\": rpc error: code = NotFound desc = could not find container \"ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a\": container with ID starting with ddb711e85fd2336b2915317b27a85c77e1c2af1cfa50228cd1aa7c199cd94d8a not found: ID does not exist" Nov 02 14:05:57.750023 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.749993 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-cacerts\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-cacerts\") pod \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " Nov 02 14:05:57.750163 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.750032 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-kubeconfig\") pod \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " Nov 02 14:05:57.750213 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.750156 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-local-certs\") pod \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " Nov 02 14:05:57.750275 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.750215 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-dns-cert\") pod \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " Nov 02 14:05:57.750275 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.750267 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-kube-api-access-pgxvk\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-kube-api-access-pgxvk\") pod \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " Nov 02 14:05:57.750391 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.750367 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-token\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-token\") pod \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " Nov 02 14:05:57.750482 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.750444 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-ca-configmap\") pod \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\" (UID: \"002dcbb4-a8f9-4642-9c36-eb1e1bca5e08\") " Nov 02 14:05:57.751165 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.751044 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-ca-configmap" pod "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" (UID: "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:05:57.752459 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.752433 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-local-certs" pod "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" (UID: "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Nov 02 14:05:57.753008 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.752987 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-token" pod "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" (UID: "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:05:57.753106 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.753006 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-cacerts" pod "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" (UID: "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:05:57.753106 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.753025 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-kubeconfig" pod "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" (UID: "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:05:57.753193 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.753100 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-kube-api-access-pgxvk" pod "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" (UID: "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08"). InnerVolumeSpecName "kube-api-access-pgxvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:05:57.753193 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.753109 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-dns-cert" pod "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" (UID: "002dcbb4-a8f9-4642-9c36-eb1e1bca5e08"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:05:57.851781 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.851749 5081 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-cacerts\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:05:57.851781 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.851777 5081 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-kubeconfig\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:05:57.851781 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.851787 5081 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-local-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:05:57.852043 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.851797 5081 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-dns-cert\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:05:57.852043 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.851807 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgxvk\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-kube-api-access-pgxvk\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:05:57.852043 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.851815 5081 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-token\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:05:57.852043 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:57.851827 5081 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08-istio-csr-ca-configmap\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:05:58.019001 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:58.018969 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr"] Nov 02 14:05:58.031675 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:58.031627 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-2wppr"] Nov 02 14:05:58.136974 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:05:58.136939 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" path="/var/lib/kubelet/pods/002dcbb4-a8f9-4642-9c36-eb1e1bca5e08/volumes" Nov 02 14:06:04.642839 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:06:04.642800 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:06:08.554780 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:06:08.554742 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:06:22.877448 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:06:22.877359 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:06:33.050576 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:06:33.050513 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:06:38.555877 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:06:38.555839 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:07:01.410056 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:01.410018 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:07:06.122927 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:06.122882 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:07:08.555051 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:07:08.555004 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:07:17.021374 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.021334 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54"] Nov 02 14:07:17.022284 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022257 5081 cpu_manager.go:414] "containerMap: removing container" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022284 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022306 5081 cpu_manager.go:414] "containerMap: removing container" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022315 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022325 5081 cpu_manager.go:414] "containerMap: removing container" podUID="afacadb4-19ec-4ef4-a556-f38b251c7b81" containerName="maas-api" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022335 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="afacadb4-19ec-4ef4-a556-f38b251c7b81" containerName="maas-api" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022348 5081 cpu_manager.go:414] "containerMap: removing container" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022356 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022371 5081 cpu_manager.go:414] "containerMap: removing container" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022378 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022387 5081 cpu_manager.go:414] "containerMap: removing container" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022393 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022405 5081 cpu_manager.go:414] "containerMap: removing container" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022412 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022422 5081 cpu_manager.go:414] "containerMap: removing container" podUID="3536ef66-306b-4eac-8aba-3b3c64e4fb17" containerName="maas-api" Nov 02 14:07:17.022422 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022428 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3536ef66-306b-4eac-8aba-3b3c64e4fb17" containerName="maas-api" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022439 5081 cpu_manager.go:414] "containerMap: removing container" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022445 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022457 5081 cpu_manager.go:414] "containerMap: removing container" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022464 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022476 5081 cpu_manager.go:414] "containerMap: removing container" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022482 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022492 5081 cpu_manager.go:414] "containerMap: removing container" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022498 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022507 5081 cpu_manager.go:414] "containerMap: removing container" podUID="002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" containerName="discovery" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022513 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" containerName="discovery" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022524 5081 cpu_manager.go:414] "containerMap: removing container" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022547 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022560 5081 cpu_manager.go:414] "containerMap: removing container" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022566 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022577 5081 cpu_manager.go:414] "containerMap: removing container" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022584 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022597 5081 cpu_manager.go:414] "containerMap: removing container" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022603 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022610 5081 cpu_manager.go:414] "containerMap: removing container" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022615 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022625 5081 cpu_manager.go:414] "containerMap: removing container" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022632 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022649 5081 cpu_manager.go:414] "containerMap: removing container" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.022656 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023005 5081 cpu_manager.go:414] "containerMap: removing container" podUID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" containerName="payload-pre-processing" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023019 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" containerName="payload-pre-processing" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023053 5081 cpu_manager.go:414] "containerMap: removing container" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023062 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023073 5081 cpu_manager.go:414] "containerMap: removing container" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023080 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023096 5081 cpu_manager.go:414] "containerMap: removing container" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023102 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023116 5081 cpu_manager.go:414] "containerMap: removing container" podUID="33df33e4-615f-4113-92ac-55e523b1f4a2" containerName="payload-pre-processing" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023123 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33df33e4-615f-4113-92ac-55e523b1f4a2" containerName="payload-pre-processing" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023132 5081 cpu_manager.go:414] "containerMap: removing container" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023138 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023147 5081 cpu_manager.go:414] "containerMap: removing container" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023153 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023166 5081 cpu_manager.go:414] "containerMap: removing container" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023172 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023188 5081 cpu_manager.go:414] "containerMap: removing container" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" Nov 02 14:07:17.023173 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023196 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023216 5081 cpu_manager.go:414] "containerMap: removing container" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023223 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023232 5081 cpu_manager.go:414] "containerMap: removing container" podUID="2873d94d-fa24-4939-aff8-c318be872a69" containerName="maas-api" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023239 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2873d94d-fa24-4939-aff8-c318be872a69" containerName="maas-api" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023248 5081 cpu_manager.go:414] "containerMap: removing container" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023255 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023268 5081 cpu_manager.go:414] "containerMap: removing container" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023275 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023431 5081 cpu_manager.go:414] "containerMap: removing container" podUID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" containerName="payload-pre-processing" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023441 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" containerName="payload-pre-processing" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023457 5081 cpu_manager.go:414] "containerMap: removing container" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023465 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023649 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc6d8abf-df1f-4eab-8022-8e881d76d904" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023669 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023683 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023693 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="002dcbb4-a8f9-4642-9c36-eb1e1bca5e08" containerName="discovery" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023705 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="abe51860-6a34-4dfd-a082-29e7b32e5bda" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023714 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="ff686aee-f0df-446f-9d55-bda087ab3c55" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023723 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="482197d0-d58c-4b66-8b51-54479f513872" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023732 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8d59e7b-7d97-4e82-9c10-6d48ea48d3f5" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023741 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d9a70f0-14fd-499d-8c22-3c759273ca0d" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023752 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="86eda318-c68d-4735-9664-92a444391b24" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023765 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023773 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="741f4b41-95c3-46d3-9951-8cb43f2c1b9e" containerName="payload-pre-processing" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023781 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="50c49511-9a94-4bfe-86fd-22fcfaac6437" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023792 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cfe71f5-f880-4ef0-8d45-3b38a89307eb" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023802 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023812 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="271043d1-af63-44b3-a36a-5d8f3f3c6c5d" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023822 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="33df33e4-615f-4113-92ac-55e523b1f4a2" containerName="payload-pre-processing" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023832 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="49b57ce4-647b-4e78-ba2b-67853d9d905a" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023841 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023849 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="d388d07c-c4e2-4479-8a89-89408647220f" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023860 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="30bfddcb-5159-478f-9763-e04eca085914" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023874 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="5bf1d379-625a-4bdb-881d-cf1e8bf48bfd" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023886 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="2873d94d-fa24-4939-aff8-c318be872a69" containerName="maas-api" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023894 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="76673f96-b245-4c84-af4e-8926e7a32211" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023906 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="255fbdd1-64c6-4d86-94c1-821afa5d6e19" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023917 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ce893fe-d5d5-4c55-9a31-d76889d2567e" containerName="payload-pre-processing" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023927 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="c792b0b7-4f8e-44af-b12c-f273cb2ebbd8" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023938 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="6b59d0a2-d0c6-459e-98c5-fecd312679a0" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023966 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.023976 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="afacadb4-19ec-4ef4-a556-f38b251c7b81" containerName="maas-api" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.024007 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="4ad76a45-130a-489d-8d24-f6591444324b" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.024016 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="9e81bc9f-90ea-434d-85e3-26811d3ca796" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.024026 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="21ff4abc-91e1-4a5a-ad8c-038733af2132" containerName="istio-proxy" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.024048 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="3536ef66-306b-4eac-8aba-3b3c64e4fb17" containerName="maas-api" Nov 02 14:07:17.024692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.024057 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="2fdcc35a-e07d-482b-a45e-0b5143ce4cfb" containerName="istio-proxy" Nov 02 14:07:17.028381 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.028356 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.056750 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.056692 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-0c51da-serving-cert\"" Nov 02 14:07:17.061307 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.061280 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54"] Nov 02 14:07:17.078054 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.078015 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.078223 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.078148 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdx7t\" (UniqueName: \"kubernetes.io/projected/81585349-1f4c-4b97-bb3b-37833b734ad1-kube-api-access-sdx7t\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.078315 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.078257 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81585349-1f4c-4b97-bb3b-37833b734ad1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.078371 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.078311 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.179721 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.179681 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdx7t\" (UniqueName: \"kubernetes.io/projected/81585349-1f4c-4b97-bb3b-37833b734ad1-kube-api-access-sdx7t\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.179924 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.179799 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81585349-1f4c-4b97-bb3b-37833b734ad1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.179924 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.179849 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.180017 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.179942 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.180449 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.180424 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81585349-1f4c-4b97-bb3b-37833b734ad1-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.182510 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.182485 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.182510 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.182500 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-metrics-certs\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.195154 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.195129 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdx7t\" (UniqueName: \"kubernetes.io/projected/81585349-1f4c-4b97-bb3b-37833b734ad1-kube-api-access-sdx7t\") pod \"maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.363613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.363437 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:17.656998 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.656966 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54"] Nov 02 14:07:17.663196 ip-10-0-134-60 kubenswrapper[5081]: W1102 14:07:17.663164 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81585349_1f4c_4b97_bb3b_37833b734ad1.slice/crio-5d121c1686b7ab29c5d8411b911c50f0744ff96a3878a7d98ac09e712bc4b7fb WatchSource:0}: Error finding container 5d121c1686b7ab29c5d8411b911c50f0744ff96a3878a7d98ac09e712bc4b7fb: Status 404 returned error can't find the container with id 5d121c1686b7ab29c5d8411b911c50f0744ff96a3878a7d98ac09e712bc4b7fb Nov 02 14:07:17.665042 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:17.665019 5081 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 14:07:18.236594 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:18.236562 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" event={"ID":"81585349-1f4c-4b97-bb3b-37833b734ad1","Type":"ContainerStarted","Data":"5d121c1686b7ab29c5d8411b911c50f0744ff96a3878a7d98ac09e712bc4b7fb"} Nov 02 14:07:19.244268 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:19.244229 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" event={"ID":"81585349-1f4c-4b97-bb3b-37833b734ad1","Type":"ContainerStarted","Data":"eb2ba73bc246678000e82cb545e9ba439523c26f62585b2ba2ff0dbe08aaed6a"} Nov 02 14:07:19.244710 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:19.244422 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:19.267350 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:19.267295 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" podStartSLOduration=2.677944884 podStartE2EDuration="3.267282737s" totalImagesPullingTime="589.337853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:07:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:07:19.265339549 +0000 UTC m=+1457.257727833" watchObservedRunningTime="2026-11-02 14:07:19.267282737 +0000 UTC m=+1457.259671037" Nov 02 14:07:20.042156 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:20.042120 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:07:25.255144 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:25.255112 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:07:35.355060 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:35.355024 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:07:38.555839 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:07:38.555799 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:07:50.250091 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:07:50.249998 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:08:04.563335 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:04.563305 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:08:04.585829 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:04.585798 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:08:08.556214 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:08:08.556184 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:08:14.437500 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:14.437462 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:08:24.483507 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.483471 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54"] Nov 02 14:08:24.484145 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.483779 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" podUID="81585349-1f4c-4b97-bb3b-37833b734ad1" containerName="maas-api" containerID="cri-o://eb2ba73bc246678000e82cb545e9ba439523c26f62585b2ba2ff0dbe08aaed6a" gracePeriod=30 Nov 02 14:08:24.602083 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.601977 5081 generic.go:356] "Generic (PLEG): container finished" podID="81585349-1f4c-4b97-bb3b-37833b734ad1" containerID="eb2ba73bc246678000e82cb545e9ba439523c26f62585b2ba2ff0dbe08aaed6a" exitCode=0 Nov 02 14:08:24.602083 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.602025 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" event={"ID":"81585349-1f4c-4b97-bb3b-37833b734ad1","Type":"ContainerDied","Data":"eb2ba73bc246678000e82cb545e9ba439523c26f62585b2ba2ff0dbe08aaed6a"} Nov 02 14:08:24.765838 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.765814 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:08:24.926696 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.925669 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/81585349-1f4c-4b97-bb3b-37833b734ad1-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81585349-1f4c-4b97-bb3b-37833b734ad1-openshift-service-ca\") pod \"81585349-1f4c-4b97-bb3b-37833b734ad1\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " Nov 02 14:08:24.926696 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.925783 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-maas-api-tls\") pod \"81585349-1f4c-4b97-bb3b-37833b734ad1\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " Nov 02 14:08:24.926696 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.925893 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-metrics-certs\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-metrics-certs\") pod \"81585349-1f4c-4b97-bb3b-37833b734ad1\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " Nov 02 14:08:24.926696 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.926010 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/81585349-1f4c-4b97-bb3b-37833b734ad1-kube-api-access-sdx7t\" (UniqueName: \"kubernetes.io/projected/81585349-1f4c-4b97-bb3b-37833b734ad1-kube-api-access-sdx7t\") pod \"81585349-1f4c-4b97-bb3b-37833b734ad1\" (UID: \"81585349-1f4c-4b97-bb3b-37833b734ad1\") " Nov 02 14:08:24.928249 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.928204 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81585349-1f4c-4b97-bb3b-37833b734ad1-openshift-service-ca" pod "81585349-1f4c-4b97-bb3b-37833b734ad1" (UID: "81585349-1f4c-4b97-bb3b-37833b734ad1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:08:24.931383 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.931357 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-maas-api-tls" pod "81585349-1f4c-4b97-bb3b-37833b734ad1" (UID: "81585349-1f4c-4b97-bb3b-37833b734ad1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:08:24.931518 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.931396 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81585349-1f4c-4b97-bb3b-37833b734ad1-kube-api-access-sdx7t" pod "81585349-1f4c-4b97-bb3b-37833b734ad1" (UID: "81585349-1f4c-4b97-bb3b-37833b734ad1"). InnerVolumeSpecName "kube-api-access-sdx7t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:08:24.931774 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:24.931728 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-metrics-certs" pod "81585349-1f4c-4b97-bb3b-37833b734ad1" (UID: "81585349-1f4c-4b97-bb3b-37833b734ad1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:08:25.027879 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.027798 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:08:25.027879 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.027828 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdx7t\" (UniqueName: \"kubernetes.io/projected/81585349-1f4c-4b97-bb3b-37833b734ad1-kube-api-access-sdx7t\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:08:25.027879 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.027839 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/81585349-1f4c-4b97-bb3b-37833b734ad1-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:08:25.027879 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.027847 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/81585349-1f4c-4b97-bb3b-37833b734ad1-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:08:25.609428 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.609397 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" Nov 02 14:08:25.609428 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.609407 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54" event={"ID":"81585349-1f4c-4b97-bb3b-37833b734ad1","Type":"ContainerDied","Data":"5d121c1686b7ab29c5d8411b911c50f0744ff96a3878a7d98ac09e712bc4b7fb"} Nov 02 14:08:25.609974 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.609464 5081 scope.go:122] "RemoveContainer" containerID="eb2ba73bc246678000e82cb545e9ba439523c26f62585b2ba2ff0dbe08aaed6a" Nov 02 14:08:25.637830 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.637800 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54"] Nov 02 14:08:25.646772 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:25.646746 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-0c51da-677cd7d978-8hs54"] Nov 02 14:08:26.137391 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:26.137363 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="81585349-1f4c-4b97-bb3b-37833b734ad1" path="/var/lib/kubelet/pods/81585349-1f4c-4b97-bb3b-37833b734ad1/volumes" Nov 02 14:08:26.339449 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:08:26.339419 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:08:38.556008 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:08:38.555967 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:09:08.555388 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:09:08.555348 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:09:38.556242 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:09:38.556201 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:10:08.556556 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:10:08.556502 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:10:32.224523 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:10:32.224487 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:10:38.556287 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:10:38.556243 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:10:47.244427 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:10:47.244344 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:10:52.173563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:10:52.168229 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:11:06.114688 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:06.114648 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:11:08.555437 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:11:08.555390 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:11:12.082794 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.082754 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj"] Nov 02 14:11:12.083285 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083212 5081 cpu_manager.go:414] "containerMap: removing container" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" Nov 02 14:11:12.083285 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083225 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f23c23fc-8ea5-4847-adf2-cac7f1ba0e03" containerName="istio-proxy" Nov 02 14:11:12.083285 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083242 5081 cpu_manager.go:414] "containerMap: removing container" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" Nov 02 14:11:12.083285 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083247 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" Nov 02 14:11:12.083285 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083280 5081 cpu_manager.go:414] "containerMap: removing container" podUID="81585349-1f4c-4b97-bb3b-37833b734ad1" containerName="maas-api" Nov 02 14:11:12.083285 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083286 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="81585349-1f4c-4b97-bb3b-37833b734ad1" containerName="maas-api" Nov 02 14:11:12.083600 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083349 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="81585349-1f4c-4b97-bb3b-37833b734ad1" containerName="maas-api" Nov 02 14:11:12.083600 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083360 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="a482589f-cadc-4514-9380-8476579441b3" containerName="istio-proxy" Nov 02 14:11:12.083600 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.083368 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="283c4feb-95be-47e3-9d31-053a440c6e4b" containerName="cleanup" Nov 02 14:11:12.086868 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.086846 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.097991 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.097961 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-7346d7-serving-cert\"" Nov 02 14:11:12.102789 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.102761 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj"] Nov 02 14:11:12.167093 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.167046 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6564\" (UniqueName: \"kubernetes.io/projected/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-kube-api-access-v6564\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.167279 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.167113 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.167279 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.167234 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.167368 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.167286 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-metrics-certs\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.268917 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.268854 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6564\" (UniqueName: \"kubernetes.io/projected/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-kube-api-access-v6564\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.269172 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.268933 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.269172 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.268984 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.269172 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.269030 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-metrics-certs\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.269172 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:11:12.269150 5081 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-serving-cert: secret "maas-api-e2e-worker-single-main-7346d7-serving-cert" not found Nov 02 14:11:12.269587 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:11:12.269269 5081 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls podName:9facb2e5-e4f0-468b-a64e-3344bb5f7b74 nodeName:}" failed. No retries permitted until 2026-11-02 14:11:12.769245073 +0000 UTC m=+1690.761633346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls") pod "maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" (UID: "9facb2e5-e4f0-468b-a64e-3344bb5f7b74") : secret "maas-api-e2e-worker-single-main-7346d7-serving-cert" not found Nov 02 14:11:12.269664 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.269619 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.271713 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.271690 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-metrics-certs\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.286656 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.286625 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6564\" (UniqueName: \"kubernetes.io/projected/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-kube-api-access-v6564\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.776034 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.776001 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:12.778623 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:12.778596 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:13.006281 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:13.006244 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:13.291984 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:13.291951 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj"] Nov 02 14:11:13.294275 ip-10-0-134-60 kubenswrapper[5081]: W1102 14:11:13.294242 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9facb2e5_e4f0_468b_a64e_3344bb5f7b74.slice/crio-8a8af0e9ec9a2938aa37d7b267230b4d2155c2175a30d2563bf8331b9a02331b WatchSource:0}: Error finding container 8a8af0e9ec9a2938aa37d7b267230b4d2155c2175a30d2563bf8331b9a02331b: Status 404 returned error can't find the container with id 8a8af0e9ec9a2938aa37d7b267230b4d2155c2175a30d2563bf8331b9a02331b Nov 02 14:11:13.593376 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:13.593344 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" event={"ID":"9facb2e5-e4f0-468b-a64e-3344bb5f7b74","Type":"ContainerStarted","Data":"8a8af0e9ec9a2938aa37d7b267230b4d2155c2175a30d2563bf8331b9a02331b"} Nov 02 14:11:14.381841 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:14.381806 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:11:14.602368 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:14.602332 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" event={"ID":"9facb2e5-e4f0-468b-a64e-3344bb5f7b74","Type":"ContainerStarted","Data":"065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7"} Nov 02 14:11:14.602713 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:14.602680 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:14.628415 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:14.628341 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" podStartSLOduration=2.149864042 podStartE2EDuration="2.628320759s" totalImagesPullingTime="478.456717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:11:14.627274603 +0000 UTC m=+1692.619662947" watchObservedRunningTime="2026-11-02 14:11:14.628320759 +0000 UTC m=+1692.620709045" Nov 02 14:11:20.613767 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:20.613732 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:11:30.053811 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:30.053772 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:11:38.555901 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:11:38.555862 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:11:58.652379 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:11:58.652342 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:12:08.556530 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:12:08.556491 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:12:21.248980 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:21.248943 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:12:31.283333 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.283294 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj"] Nov 02 14:12:31.283916 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.283499 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" podUID="9facb2e5-e4f0-468b-a64e-3344bb5f7b74" containerName="maas-api" containerID="cri-o://065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7" gracePeriod=30 Nov 02 14:12:31.570249 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.570219 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:12:31.627573 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.627525 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-kube-api-access-v6564\" (UniqueName: \"kubernetes.io/projected/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-kube-api-access-v6564\") pod \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " Nov 02 14:12:31.627760 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.627596 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-openshift-service-ca\") pod \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " Nov 02 14:12:31.627760 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.627654 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls\") pod \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " Nov 02 14:12:31.627760 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.627720 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-metrics-certs\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-metrics-certs\") pod \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\" (UID: \"9facb2e5-e4f0-468b-a64e-3344bb5f7b74\") " Nov 02 14:12:31.628037 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.628006 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-openshift-service-ca" pod "9facb2e5-e4f0-468b-a64e-3344bb5f7b74" (UID: "9facb2e5-e4f0-468b-a64e-3344bb5f7b74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:12:31.629917 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.629888 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-kube-api-access-v6564" pod "9facb2e5-e4f0-468b-a64e-3344bb5f7b74" (UID: "9facb2e5-e4f0-468b-a64e-3344bb5f7b74"). InnerVolumeSpecName "kube-api-access-v6564". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:12:31.630021 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.629946 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls" pod "9facb2e5-e4f0-468b-a64e-3344bb5f7b74" (UID: "9facb2e5-e4f0-468b-a64e-3344bb5f7b74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:12:31.630021 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.629989 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-metrics-certs" pod "9facb2e5-e4f0-468b-a64e-3344bb5f7b74" (UID: "9facb2e5-e4f0-468b-a64e-3344bb5f7b74"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:12:31.729097 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.729060 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:12:31.729097 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.729095 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6564\" (UniqueName: \"kubernetes.io/projected/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-kube-api-access-v6564\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:12:31.729097 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.729105 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:12:31.729343 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:31.729116 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9facb2e5-e4f0-468b-a64e-3344bb5f7b74-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:12:32.019791 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.019752 5081 generic.go:356] "Generic (PLEG): container finished" podID="9facb2e5-e4f0-468b-a64e-3344bb5f7b74" containerID="065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7" exitCode=0 Nov 02 14:12:32.019791 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.019794 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" Nov 02 14:12:32.020100 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.019841 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" event={"ID":"9facb2e5-e4f0-468b-a64e-3344bb5f7b74","Type":"ContainerDied","Data":"065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7"} Nov 02 14:12:32.020100 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.019902 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj" event={"ID":"9facb2e5-e4f0-468b-a64e-3344bb5f7b74","Type":"ContainerDied","Data":"8a8af0e9ec9a2938aa37d7b267230b4d2155c2175a30d2563bf8331b9a02331b"} Nov 02 14:12:32.020100 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.019934 5081 scope.go:122] "RemoveContainer" containerID="065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7" Nov 02 14:12:32.030363 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.030345 5081 scope.go:122] "RemoveContainer" containerID="065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7" Nov 02 14:12:32.030659 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:12:32.030631 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7\": container with ID starting with 065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7 not found: ID does not exist" containerID="065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7" Nov 02 14:12:32.030768 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.030669 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7"} err="failed to get container status \"065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7\": rpc error: code = NotFound desc = could not find container \"065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7\": container with ID starting with 065f5efd5677b0ffbb5cebf6fc32f3c850f8b433830367a4274a7b8b7c9796c7 not found: ID does not exist" Nov 02 14:12:32.054631 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.054581 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj"] Nov 02 14:12:32.058985 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.058960 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-7346d7-557fc7cf47-2hhfj"] Nov 02 14:12:32.137803 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:32.137771 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9facb2e5-e4f0-468b-a64e-3344bb5f7b74" path="/var/lib/kubelet/pods/9facb2e5-e4f0-468b-a64e-3344bb5f7b74/volumes" Nov 02 14:12:33.430514 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:33.430482 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:12:38.557663 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:12:38.557609 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:12:57.135256 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:57.135222 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:12:59.893563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:59.892707 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:12:59.893563 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:12:59.892802 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:13:04.595964 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:04.595936 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:13:04.619433 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:04.619403 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:13:08.556838 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:13:08.556800 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:13:11.758662 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:11.758619 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:13:14.897565 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:14.892645 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:13:14.897565 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:14.892751 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-rcdvr" podUID="e9a681d7-5f8e-43bb-9506-5fe18c312e7c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:13:27.449041 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:27.449005 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:13:38.555621 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:13:38.555574 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:13:39.471066 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:39.471024 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:13:42.272525 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:42.272418 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:13:42.273147 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:42.273112 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:13:42.277782 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:42.277727 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:13:42.278037 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:42.277990 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:13:44.690507 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:44.690463 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:13:51.966200 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:51.966160 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:13:56.751560 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:56.744441 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:13:57.271564 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:57.270662 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-n4k85 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:13:57.271564 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:57.270753 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-n4k85" podUID="431cb77d-7b44-485d-93c8-9095ed1776f0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:13:57.284566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:57.279698 5081 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-8b64f9ff9-h78x6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Nov 02 14:13:57.284566 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:13:57.279777 5081 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-8b64f9ff9-h78x6" podUID="7212b4c4-ccfc-495c-ba5b-1171ab72b7df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Nov 02 14:14:08.556335 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:14:08.556293 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:14:12.230488 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:12.230450 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:14:13.492703 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.492661 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4"] Nov 02 14:14:13.493380 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.493359 5081 cpu_manager.go:414] "containerMap: removing container" podUID="9facb2e5-e4f0-468b-a64e-3344bb5f7b74" containerName="maas-api" Nov 02 14:14:13.493380 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.493378 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9facb2e5-e4f0-468b-a64e-3344bb5f7b74" containerName="maas-api" Nov 02 14:14:13.493783 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.493559 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="9facb2e5-e4f0-468b-a64e-3344bb5f7b74" containerName="maas-api" Nov 02 14:14:13.497382 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.497360 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.511801 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.511772 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4"] Nov 02 14:14:13.577596 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.577565 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fb830f-2113-4660-a392-2e662a609aad-openshift-service-ca\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.577805 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.577608 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79fb830f-2113-4660-a392-2e662a609aad-maas-api-tls\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.577805 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.577742 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fb830f-2113-4660-a392-2e662a609aad-metrics-certs\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.577805 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.577787 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcpff\" (UniqueName: \"kubernetes.io/projected/79fb830f-2113-4660-a392-2e662a609aad-kube-api-access-rcpff\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.678767 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.678729 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fb830f-2113-4660-a392-2e662a609aad-metrics-certs\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.678956 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.678777 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcpff\" (UniqueName: \"kubernetes.io/projected/79fb830f-2113-4660-a392-2e662a609aad-kube-api-access-rcpff\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.678956 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.678857 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fb830f-2113-4660-a392-2e662a609aad-openshift-service-ca\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.678956 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.678882 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79fb830f-2113-4660-a392-2e662a609aad-maas-api-tls\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.679618 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.679590 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/79fb830f-2113-4660-a392-2e662a609aad-openshift-service-ca\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.681505 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.681484 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79fb830f-2113-4660-a392-2e662a609aad-maas-api-tls\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.681656 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.681632 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79fb830f-2113-4660-a392-2e662a609aad-metrics-certs\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.692438 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.692411 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcpff\" (UniqueName: \"kubernetes.io/projected/79fb830f-2113-4660-a392-2e662a609aad-kube-api-access-rcpff\") pod \"maas-api-556bc67b74-nkrt4\" (UID: \"79fb830f-2113-4660-a392-2e662a609aad\") " pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:13.814932 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:13.814847 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:14.099557 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:14.099516 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4"] Nov 02 14:14:14.101353 ip-10-0-134-60 kubenswrapper[5081]: W1102 14:14:14.101318 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79fb830f_2113_4660_a392_2e662a609aad.slice/crio-6eb2cef7bb6aa6705e7f9e121fdd0004649c6fb0be7b4c704bf9cad8537d33e3 WatchSource:0}: Error finding container 6eb2cef7bb6aa6705e7f9e121fdd0004649c6fb0be7b4c704bf9cad8537d33e3: Status 404 returned error can't find the container with id 6eb2cef7bb6aa6705e7f9e121fdd0004649c6fb0be7b4c704bf9cad8537d33e3 Nov 02 14:14:14.102730 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:14.102714 5081 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Nov 02 14:14:14.872399 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:14.872352 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" event={"ID":"79fb830f-2113-4660-a392-2e662a609aad","Type":"ContainerStarted","Data":"63b6b9be676859c404480fd6145501ded07d1728a9bf5f4ab11f185b46b9f253"} Nov 02 14:14:14.872870 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:14.872406 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" event={"ID":"79fb830f-2113-4660-a392-2e662a609aad","Type":"ContainerStarted","Data":"6eb2cef7bb6aa6705e7f9e121fdd0004649c6fb0be7b4c704bf9cad8537d33e3"} Nov 02 14:14:14.872870 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:14.872515 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:14.896662 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:14.896574 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" podStartSLOduration=1.374954666 podStartE2EDuration="1.896560359s" totalImagesPullingTime="521.605693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:14:14.895950183 +0000 UTC m=+1872.888338469" watchObservedRunningTime="2026-11-02 14:14:14.896560359 +0000 UTC m=+1872.888948634" Nov 02 14:14:20.883404 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:20.883371 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-556bc67b74-nkrt4" Nov 02 14:14:24.714397 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.714363 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr"] Nov 02 14:14:24.718803 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.718779 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.735585 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.735557 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8ecb8add-serving-cert\"" Nov 02 14:14:24.739325 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.739293 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr"] Nov 02 14:14:24.795613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.795584 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-metrics-certs\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.795818 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.795623 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-maas-api-tls\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.795818 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.795732 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-openshift-service-ca\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.795920 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.795844 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smrqk\" (UniqueName: \"kubernetes.io/projected/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-kube-api-access-smrqk\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.896899 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.896855 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smrqk\" (UniqueName: \"kubernetes.io/projected/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-kube-api-access-smrqk\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.897110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.897034 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-metrics-certs\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.897110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.897074 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-maas-api-tls\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.897238 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.897134 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-openshift-service-ca\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.898118 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.898018 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-openshift-service-ca\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.900815 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.900786 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-maas-api-tls\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.900966 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.900789 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-metrics-certs\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:24.925425 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:24.925392 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smrqk\" (UniqueName: \"kubernetes.io/projected/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-kube-api-access-smrqk\") pod \"maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:25.039762 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:25.039670 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:25.323494 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:25.323469 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr"] Nov 02 14:14:25.326036 ip-10-0-134-60 kubenswrapper[5081]: W1102 14:14:25.326006 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8361fd_d3ea_4bfc_9b35_c29c474917d3.slice/crio-4982b232fcd3236f47189b35b5f4509e359e2f0ef6f5f91ddc30f046d150e39e WatchSource:0}: Error finding container 4982b232fcd3236f47189b35b5f4509e359e2f0ef6f5f91ddc30f046d150e39e: Status 404 returned error can't find the container with id 4982b232fcd3236f47189b35b5f4509e359e2f0ef6f5f91ddc30f046d150e39e Nov 02 14:14:25.937666 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:25.937631 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" event={"ID":"6f8361fd-d3ea-4bfc-9b35-c29c474917d3","Type":"ContainerStarted","Data":"507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc"} Nov 02 14:14:25.938159 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:25.937689 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" event={"ID":"6f8361fd-d3ea-4bfc-9b35-c29c474917d3","Type":"ContainerStarted","Data":"4982b232fcd3236f47189b35b5f4509e359e2f0ef6f5f91ddc30f046d150e39e"} Nov 02 14:14:25.938159 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:25.937716 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:25.965206 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:25.965156 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" podStartSLOduration=1.5348187210000002 podStartE2EDuration="1.965141209s" totalImagesPullingTime="430.322488ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:14:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:14:25.963611884 +0000 UTC m=+1883.956000169" watchObservedRunningTime="2026-11-02 14:14:25.965141209 +0000 UTC m=+1883.957529492" Nov 02 14:14:26.933096 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:26.933060 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:14:29.212465 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:29.212426 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2"] Nov 02 14:14:29.212999 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:29.212688 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" podUID="01ebdc50-136a-4e70-939b-8b86ad69587a" containerName="maas-api" containerID="cri-o://deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d" gracePeriod=30 Nov 02 14:14:30.483273 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.483247 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 14:14:30.558755 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.558663 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-maas-api-tls\") pod \"01ebdc50-136a-4e70-939b-8b86ad69587a\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " Nov 02 14:14:30.558755 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.558721 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/01ebdc50-136a-4e70-939b-8b86ad69587a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ebdc50-136a-4e70-939b-8b86ad69587a-openshift-service-ca\") pod \"01ebdc50-136a-4e70-939b-8b86ad69587a\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " Nov 02 14:14:30.558990 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.558871 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-metrics-certs\") pod \"01ebdc50-136a-4e70-939b-8b86ad69587a\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " Nov 02 14:14:30.558990 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.558906 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/01ebdc50-136a-4e70-939b-8b86ad69587a-kube-api-access-fs745\" (UniqueName: \"kubernetes.io/projected/01ebdc50-136a-4e70-939b-8b86ad69587a-kube-api-access-fs745\") pod \"01ebdc50-136a-4e70-939b-8b86ad69587a\" (UID: \"01ebdc50-136a-4e70-939b-8b86ad69587a\") " Nov 02 14:14:30.559166 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.559114 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ebdc50-136a-4e70-939b-8b86ad69587a-openshift-service-ca" pod "01ebdc50-136a-4e70-939b-8b86ad69587a" (UID: "01ebdc50-136a-4e70-939b-8b86ad69587a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:14:30.559365 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.559347 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ebdc50-136a-4e70-939b-8b86ad69587a-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:30.561207 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.561180 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-maas-api-tls" pod "01ebdc50-136a-4e70-939b-8b86ad69587a" (UID: "01ebdc50-136a-4e70-939b-8b86ad69587a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:14:30.561207 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.561201 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-metrics-certs" pod "01ebdc50-136a-4e70-939b-8b86ad69587a" (UID: "01ebdc50-136a-4e70-939b-8b86ad69587a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:14:30.561348 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.561223 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ebdc50-136a-4e70-939b-8b86ad69587a-kube-api-access-fs745" pod "01ebdc50-136a-4e70-939b-8b86ad69587a" (UID: "01ebdc50-136a-4e70-939b-8b86ad69587a"). InnerVolumeSpecName "kube-api-access-fs745". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:14:30.661077 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.661036 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:30.661077 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.661075 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs745\" (UniqueName: \"kubernetes.io/projected/01ebdc50-136a-4e70-939b-8b86ad69587a-kube-api-access-fs745\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:30.661296 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.661103 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ebdc50-136a-4e70-939b-8b86ad69587a-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:30.966277 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.966237 5081 generic.go:356] "Generic (PLEG): container finished" podID="01ebdc50-136a-4e70-939b-8b86ad69587a" containerID="deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d" exitCode=0 Nov 02 14:14:30.966461 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.966311 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" Nov 02 14:14:30.966461 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.966332 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" event={"ID":"01ebdc50-136a-4e70-939b-8b86ad69587a","Type":"ContainerDied","Data":"deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d"} Nov 02 14:14:30.966461 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.966421 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2" event={"ID":"01ebdc50-136a-4e70-939b-8b86ad69587a","Type":"ContainerDied","Data":"65591194e0ca4c56bbffd8897f731fb87b4cf8544687ad1564bf29cd43393bce"} Nov 02 14:14:30.966461 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.966450 5081 scope.go:122] "RemoveContainer" containerID="deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d" Nov 02 14:14:30.977633 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.977515 5081 scope.go:122] "RemoveContainer" containerID="deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d" Nov 02 14:14:30.977904 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:14:30.977886 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d\": container with ID starting with deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d not found: ID does not exist" containerID="deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d" Nov 02 14:14:30.977962 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:30.977913 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d"} err="failed to get container status \"deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d\": rpc error: code = NotFound desc = could not find container \"deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d\": container with ID starting with deaae8c49e46bad623f91109b4cd4cecb629b4d26e4152cf3f6ffb3ff368983d not found: ID does not exist" Nov 02 14:14:31.001189 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:31.001156 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2"] Nov 02 14:14:31.003155 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:31.003129 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-8d54bcbb-57lz2"] Nov 02 14:14:31.948901 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:31.948873 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:32.138479 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:32.138436 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="01ebdc50-136a-4e70-939b-8b86ad69587a" path="/var/lib/kubelet/pods/01ebdc50-136a-4e70-939b-8b86ad69587a/volumes" Nov 02 14:14:38.556239 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:14:38.556197 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:14:45.009077 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.009018 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr"] Nov 02 14:14:45.011503 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.009304 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" podUID="6f8361fd-d3ea-4bfc-9b35-c29c474917d3" containerName="maas-api" containerID="cri-o://507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc" gracePeriod=30 Nov 02 14:14:45.295506 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.295480 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:45.439706 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.439671 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-metrics-certs\") pod \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " Nov 02 14:14:45.439910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.439726 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-openshift-service-ca\") pod \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " Nov 02 14:14:45.439910 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.439892 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-maas-api-tls\") pod \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " Nov 02 14:14:45.440029 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.439952 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-kube-api-access-smrqk\" (UniqueName: \"kubernetes.io/projected/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-kube-api-access-smrqk\") pod \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\" (UID: \"6f8361fd-d3ea-4bfc-9b35-c29c474917d3\") " Nov 02 14:14:45.440174 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.440143 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-openshift-service-ca" pod "6f8361fd-d3ea-4bfc-9b35-c29c474917d3" (UID: "6f8361fd-d3ea-4bfc-9b35-c29c474917d3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:14:45.440353 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.440336 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:45.442011 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.441982 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-metrics-certs" pod "6f8361fd-d3ea-4bfc-9b35-c29c474917d3" (UID: "6f8361fd-d3ea-4bfc-9b35-c29c474917d3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:14:45.442125 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.442114 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-maas-api-tls" pod "6f8361fd-d3ea-4bfc-9b35-c29c474917d3" (UID: "6f8361fd-d3ea-4bfc-9b35-c29c474917d3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:14:45.442203 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.442182 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-kube-api-access-smrqk" pod "6f8361fd-d3ea-4bfc-9b35-c29c474917d3" (UID: "6f8361fd-d3ea-4bfc-9b35-c29c474917d3"). InnerVolumeSpecName "kube-api-access-smrqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:14:45.541151 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.541067 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:45.541151 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.541102 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smrqk\" (UniqueName: \"kubernetes.io/projected/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-kube-api-access-smrqk\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:45.541151 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:45.541113 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6f8361fd-d3ea-4bfc-9b35-c29c474917d3-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:14:46.050992 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.050954 5081 generic.go:356] "Generic (PLEG): container finished" podID="6f8361fd-d3ea-4bfc-9b35-c29c474917d3" containerID="507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc" exitCode=0 Nov 02 14:14:46.051525 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.050998 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" Nov 02 14:14:46.051525 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.051026 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" event={"ID":"6f8361fd-d3ea-4bfc-9b35-c29c474917d3","Type":"ContainerDied","Data":"507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc"} Nov 02 14:14:46.051525 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.051076 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr" event={"ID":"6f8361fd-d3ea-4bfc-9b35-c29c474917d3","Type":"ContainerDied","Data":"4982b232fcd3236f47189b35b5f4509e359e2f0ef6f5f91ddc30f046d150e39e"} Nov 02 14:14:46.051525 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.051108 5081 scope.go:122] "RemoveContainer" containerID="507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc" Nov 02 14:14:46.061475 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.061454 5081 scope.go:122] "RemoveContainer" containerID="507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc" Nov 02 14:14:46.061797 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:14:46.061777 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc\": container with ID starting with 507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc not found: ID does not exist" containerID="507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc" Nov 02 14:14:46.061861 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.061807 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc"} err="failed to get container status \"507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc\": rpc error: code = NotFound desc = could not find container \"507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc\": container with ID starting with 507d6aa42d13d2d7583fd843e73af681fb27eeb62b51870e2c6c3ff3e26940bc not found: ID does not exist" Nov 02 14:14:46.075205 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.075174 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr"] Nov 02 14:14:46.078034 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.078011 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecb8add-7c5567d9c6-4z5gr"] Nov 02 14:14:46.136852 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.136812 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f8361fd-d3ea-4bfc-9b35-c29c474917d3" path="/var/lib/kubelet/pods/6f8361fd-d3ea-4bfc-9b35-c29c474917d3/volumes" Nov 02 14:14:46.753868 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:14:46.753834 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:15:06.686599 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.686558 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh"] Nov 02 14:15:06.687931 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.687905 5081 cpu_manager.go:414] "containerMap: removing container" podUID="6f8361fd-d3ea-4bfc-9b35-c29c474917d3" containerName="maas-api" Nov 02 14:15:06.687931 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.687932 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f8361fd-d3ea-4bfc-9b35-c29c474917d3" containerName="maas-api" Nov 02 14:15:06.688121 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.687957 5081 cpu_manager.go:414] "containerMap: removing container" podUID="01ebdc50-136a-4e70-939b-8b86ad69587a" containerName="maas-api" Nov 02 14:15:06.688121 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.687966 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="01ebdc50-136a-4e70-939b-8b86ad69587a" containerName="maas-api" Nov 02 14:15:06.688200 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.688134 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f8361fd-d3ea-4bfc-9b35-c29c474917d3" containerName="maas-api" Nov 02 14:15:06.688200 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.688150 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="01ebdc50-136a-4e70-939b-8b86ad69587a" containerName="maas-api" Nov 02 14:15:06.693224 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.693204 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.706706 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.706676 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh"] Nov 02 14:15:06.749888 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.749838 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36cd288a-406f-4d92-9a3d-6c69b816d7ea-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.750067 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.749989 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-metrics-certs\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.750067 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.750059 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zph8\" (UniqueName: \"kubernetes.io/projected/36cd288a-406f-4d92-9a3d-6c69b816d7ea-kube-api-access-2zph8\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.750206 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.750188 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.785950 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.785920 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-560eaa-serving-cert\"" Nov 02 14:15:06.851076 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.851045 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.851279 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.851084 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36cd288a-406f-4d92-9a3d-6c69b816d7ea-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.851279 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.851147 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-metrics-certs\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.851279 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.851164 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zph8\" (UniqueName: \"kubernetes.io/projected/36cd288a-406f-4d92-9a3d-6c69b816d7ea-kube-api-access-2zph8\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.852174 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.852146 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36cd288a-406f-4d92-9a3d-6c69b816d7ea-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.853957 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.853928 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-metrics-certs\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.854111 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.854088 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:06.880131 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:06.880105 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zph8\" (UniqueName: \"kubernetes.io/projected/36cd288a-406f-4d92-9a3d-6c69b816d7ea-kube-api-access-2zph8\") pod \"maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:07.008780 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:07.008695 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:07.294424 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:07.294392 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh"] Nov 02 14:15:07.295939 ip-10-0-134-60 kubenswrapper[5081]: W1102 14:15:07.295908 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36cd288a_406f_4d92_9a3d_6c69b816d7ea.slice/crio-ad92d87c0911acff6263473925f22aa010519289cfb7372d41bcdbf5e44ed85a WatchSource:0}: Error finding container ad92d87c0911acff6263473925f22aa010519289cfb7372d41bcdbf5e44ed85a: Status 404 returned error can't find the container with id ad92d87c0911acff6263473925f22aa010519289cfb7372d41bcdbf5e44ed85a Nov 02 14:15:08.173520 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:08.173478 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" event={"ID":"36cd288a-406f-4d92-9a3d-6c69b816d7ea","Type":"ContainerStarted","Data":"69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5"} Nov 02 14:15:08.173957 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:08.173558 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:08.173957 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:08.173578 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" event={"ID":"36cd288a-406f-4d92-9a3d-6c69b816d7ea","Type":"ContainerStarted","Data":"ad92d87c0911acff6263473925f22aa010519289cfb7372d41bcdbf5e44ed85a"} Nov 02 14:15:08.194445 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:08.194396 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" podStartSLOduration=1.787067972 podStartE2EDuration="2.194383872s" totalImagesPullingTime="407.3159ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-02 14:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:15:08.193296256 +0000 UTC m=+1926.185684552" watchObservedRunningTime="2026-11-02 14:15:08.194383872 +0000 UTC m=+1926.186772156" Nov 02 14:15:08.556768 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:15:08.556676 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:15:08.759569 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:08.759210 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:15:14.184676 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:15:14.184600 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:15:38.557081 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:15:38.557035 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:16:08.556027 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:16:08.555984 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:16:38.556889 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:16:38.556847 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:17:06.178127 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.178086 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh"] Nov 02 14:17:06.178579 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.178347 5081 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" podUID="36cd288a-406f-4d92-9a3d-6c69b816d7ea" containerName="maas-api" containerID="cri-o://69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5" gracePeriod=30 Nov 02 14:17:06.447237 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.447213 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:17:06.558926 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.558893 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36cd288a-406f-4d92-9a3d-6c69b816d7ea-kube-api-access-2zph8\" (UniqueName: \"kubernetes.io/projected/36cd288a-406f-4d92-9a3d-6c69b816d7ea-kube-api-access-2zph8\") pod \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " Nov 02 14:17:06.559092 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.558932 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36cd288a-406f-4d92-9a3d-6c69b816d7ea-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36cd288a-406f-4d92-9a3d-6c69b816d7ea-openshift-service-ca\") pod \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " Nov 02 14:17:06.559092 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.558978 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-metrics-certs\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-metrics-certs\") pod \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " Nov 02 14:17:06.559092 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.559052 5081 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-maas-api-tls\") pod \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\" (UID: \"36cd288a-406f-4d92-9a3d-6c69b816d7ea\") " Nov 02 14:17:06.559358 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.559330 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36cd288a-406f-4d92-9a3d-6c69b816d7ea-openshift-service-ca" pod "36cd288a-406f-4d92-9a3d-6c69b816d7ea" (UID: "36cd288a-406f-4d92-9a3d-6c69b816d7ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Nov 02 14:17:06.561364 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.561335 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-maas-api-tls" pod "36cd288a-406f-4d92-9a3d-6c69b816d7ea" (UID: "36cd288a-406f-4d92-9a3d-6c69b816d7ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:17:06.561364 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.561356 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-metrics-certs" pod "36cd288a-406f-4d92-9a3d-6c69b816d7ea" (UID: "36cd288a-406f-4d92-9a3d-6c69b816d7ea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Nov 02 14:17:06.561558 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.561354 5081 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36cd288a-406f-4d92-9a3d-6c69b816d7ea-kube-api-access-2zph8" pod "36cd288a-406f-4d92-9a3d-6c69b816d7ea" (UID: "36cd288a-406f-4d92-9a3d-6c69b816d7ea"). InnerVolumeSpecName "kube-api-access-2zph8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Nov 02 14:17:06.660408 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.660367 5081 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zph8\" (UniqueName: \"kubernetes.io/projected/36cd288a-406f-4d92-9a3d-6c69b816d7ea-kube-api-access-2zph8\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:17:06.660408 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.660401 5081 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36cd288a-406f-4d92-9a3d-6c69b816d7ea-openshift-service-ca\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:17:06.660408 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.660413 5081 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-metrics-certs\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:17:06.660694 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.660423 5081 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36cd288a-406f-4d92-9a3d-6c69b816d7ea-maas-api-tls\") on node \"ip-10-0-134-60.us-east-2.compute.internal\" DevicePath \"\"" Nov 02 14:17:06.816192 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.816102 5081 generic.go:356] "Generic (PLEG): container finished" podID="36cd288a-406f-4d92-9a3d-6c69b816d7ea" containerID="69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5" exitCode=0 Nov 02 14:17:06.816192 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.816145 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" event={"ID":"36cd288a-406f-4d92-9a3d-6c69b816d7ea","Type":"ContainerDied","Data":"69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5"} Nov 02 14:17:06.816192 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.816148 5081 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" Nov 02 14:17:06.816192 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.816189 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh" event={"ID":"36cd288a-406f-4d92-9a3d-6c69b816d7ea","Type":"ContainerDied","Data":"ad92d87c0911acff6263473925f22aa010519289cfb7372d41bcdbf5e44ed85a"} Nov 02 14:17:06.816494 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.816210 5081 scope.go:122] "RemoveContainer" containerID="69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5" Nov 02 14:17:06.826682 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.826661 5081 scope.go:122] "RemoveContainer" containerID="69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5" Nov 02 14:17:06.826955 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:17:06.826935 5081 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5\": container with ID starting with 69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5 not found: ID does not exist" containerID="69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5" Nov 02 14:17:06.827023 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.826968 5081 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5"} err="failed to get container status \"69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5\": rpc error: code = NotFound desc = could not find container \"69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5\": container with ID starting with 69aedd13b7dc5903508f90a58249eb0a5f3975622b99fec4b8b34b82aca45aa5 not found: ID does not exist" Nov 02 14:17:06.844516 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.844480 5081 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh"] Nov 02 14:17:06.846795 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:06.846775 5081 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-560eaa-79bd99bd54-jx8bh"] Nov 02 14:17:07.952423 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:07.952387 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:17:08.144520 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:08.144481 5081 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36cd288a-406f-4d92-9a3d-6c69b816d7ea" path="/var/lib/kubelet/pods/36cd288a-406f-4d92-9a3d-6c69b816d7ea/volumes" Nov 02 14:17:08.555760 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:17:08.555724 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:17:15.554281 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:15.554242 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:17:20.704194 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:20.704155 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:17:35.925181 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:17:35.925142 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:17:38.571325 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:17:38.571273 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:18:02.717123 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:02.717079 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-cwjw8"] Nov 02 14:18:04.761306 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:04.761263 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:18:04.838032 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:04.838003 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:18:08.555977 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:18:08.555930 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:18:23.286814 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:23.286735 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-746496c544-h9t8w_de16c921-fa99-4f92-8da5-a08b09395f15/manager/0.log" Nov 02 14:18:24.425193 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:24.425165 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-n4vbh_58f19ac4-9ff5-4d13-b84d-871a496942cc/server/0.log" Nov 02 14:18:24.830210 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:24.830131 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-6km7z_e677365e-b580-428a-adfc-058ad9f4f4e9/proxy/0.log" Nov 02 14:18:25.557552 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:25.557507 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-556bc67b74-nkrt4_79fb830f-2113-4660-a392-2e662a609aad/maas-api/0.log" Nov 02 14:18:28.713761 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:28.713732 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-bxrxz_daa68537-3d04-4e70-adf0-ee7423c6442d/manager/0.log" Nov 02 14:18:28.893506 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:28.893473 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-g69sv_c5c3b940-2edd-4737-99a8-1906bde0b45d/manager/0.log" Nov 02 14:18:29.487987 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:29.487956 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-cwjw8_ac632b97-36f6-4e77-91f0-72e2ea7accb7/limitador/0.log" Nov 02 14:18:30.436091 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:30.436060 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5_864086cc-7ea5-4d29-9465-ded1c7d9b6ca/istio-proxy/0.log" Nov 02 14:18:31.530497 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:31.530461 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/1.log" Nov 02 14:18:31.867270 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:31.867189 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-h78x6_7212b4c4-ccfc-495c-ba5b-1171ab72b7df/istio-proxy/0.log" Nov 02 14:18:32.556184 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:32.556151 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-n4k85_431cb77d-7b44-485d-93c8-9095ed1776f0/istio-proxy/0.log" Nov 02 14:18:32.732742 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:32.732706 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-rcdvr_e9a681d7-5f8e-43bb-9506-5fe18c312e7c/istio-proxy/0.log" Nov 02 14:18:32.899680 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:32.899588 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm_9b954ca7-cf83-4f27-8e11-4195ef387b3b/istio-proxy/0.log" Nov 02 14:18:33.392623 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:33.392589 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-744d4b8849-b5rwg_5c2be26f-f492-4cb0-a5f1-9840c4ff2437/router/0.log" Nov 02 14:18:33.793180 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:33.793147 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/0.log" Nov 02 14:18:34.277713 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:34.277683 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl_889344bf-3443-4d20-bc04-42d0ad58c833/main/0.log" Nov 02 14:18:34.642361 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:34.642262 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-ncjcq_a201a29d-c69d-48d4-8835-2d52f505708c/main/0.log" Nov 02 14:18:38.556338 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:18:38.556296 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:18:39.826521 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:39.826486 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-8mm6z_a53cbc84-390b-4287-9b3c-c2a626ea4b73/main/0.log" Nov 02 14:18:40.003958 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:40.003930 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj_360b9bb9-71ce-448a-9e99-126db49086bd/main/0.log" Nov 02 14:18:40.179804 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:40.179776 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-v9khs_f6076240-cac1-457b-8202-c1102a566ddb/main/0.log" Nov 02 14:18:40.356617 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:40.356586 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl_5118326d-d883-4097-95c2-a0c3c1d4b54f/main/0.log" Nov 02 14:18:50.492114 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:50.492082 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-746496c544-h9t8w_de16c921-fa99-4f92-8da5-a08b09395f15/manager/0.log" Nov 02 14:18:51.518402 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:51.518374 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-n4vbh_58f19ac4-9ff5-4d13-b84d-871a496942cc/server/0.log" Nov 02 14:18:51.892751 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:51.892667 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_usage-logs-tenancy-proxy-9c5d49bcd-6km7z_e677365e-b580-428a-adfc-058ad9f4f4e9/proxy/0.log" Nov 02 14:18:52.389134 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:52.389099 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-556bc67b74-nkrt4_79fb830f-2113-4660-a392-2e662a609aad/maas-api/0.log" Nov 02 14:18:54.820736 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:54.820697 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-bxrxz_daa68537-3d04-4e70-adf0-ee7423c6442d/manager/0.log" Nov 02 14:18:55.011968 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:55.011937 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-g69sv_c5c3b940-2edd-4737-99a8-1906bde0b45d/manager/0.log" Nov 02 14:18:55.610780 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:55.610747 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-cwjw8_ac632b97-36f6-4e77-91f0-72e2ea7accb7/limitador/0.log" Nov 02 14:18:56.360656 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:56.360617 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5_864086cc-7ea5-4d29-9465-ded1c7d9b6ca/istio-proxy/0.log" Nov 02 14:18:57.454933 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:57.454904 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/1.log" Nov 02 14:18:57.804629 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:57.804527 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-h78x6_7212b4c4-ccfc-495c-ba5b-1171ab72b7df/istio-proxy/0.log" Nov 02 14:18:58.513221 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:58.513190 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-n4k85_431cb77d-7b44-485d-93c8-9095ed1776f0/istio-proxy/0.log" Nov 02 14:18:58.694740 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:58.694705 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-rcdvr_e9a681d7-5f8e-43bb-9506-5fe18c312e7c/istio-proxy/0.log" Nov 02 14:18:58.908744 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:58.908713 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm_9b954ca7-cf83-4f27-8e11-4195ef387b3b/istio-proxy/0.log" Nov 02 14:18:59.419957 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:59.419920 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-744d4b8849-b5rwg_5c2be26f-f492-4cb0-a5f1-9840c4ff2437/router/0.log" Nov 02 14:18:59.950669 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:18:59.950643 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-ml2vl_889344bf-3443-4d20-bc04-42d0ad58c833/main/0.log" Nov 02 14:19:00.309235 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:19:00.309139 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-ncjcq_a201a29d-c69d-48d4-8835-2d52f505708c/main/0.log" Nov 02 14:19:00.481207 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:19:00.481168 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-8mm6z_a53cbc84-390b-4287-9b3c-c2a626ea4b73/main/0.log" Nov 02 14:19:00.666931 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:19:00.666906 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8rmxzj_360b9bb9-71ce-448a-9e99-126db49086bd/main/0.log" Nov 02 14:19:00.853741 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:19:00.853709 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-v9khs_f6076240-cac1-457b-8202-c1102a566ddb/main/0.log" Nov 02 14:19:01.029561 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:19:01.029467 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-dl9kl_5118326d-d883-4097-95c2-a0c3c1d4b54f/main/0.log" Nov 02 14:19:08.555688 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:19:08.555641 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:19:38.556025 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:19:38.555985 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:20:08.556524 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:20:08.556483 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:20:38.555909 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:20:38.555871 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:21:08.556350 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:21:08.556309 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:21:15.930397 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:15.930286 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kkccd_88248243-f1a3-4b12-a156-78be12e1add9/global-pull-secret-syncer/0.log" Nov 02 14:21:16.065457 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:16.065430 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-4fnbb_4335741f-3c45-4afb-81af-43c072a64c23/connection-checker/0.log" Nov 02 14:21:16.095142 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:16.095118 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-mvmkl_ece5836e-24ec-4d8d-b607-0fdd65af45a7/connection-checker/0.log" Nov 02 14:21:16.126189 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:16.126162 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-p4shv_4bc533a9-cb34-4ac4-a40d-c32d8cb70eda/connection-checker/0.log" Nov 02 14:21:16.313159 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:16.313080 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jz2g5_fd039fba-62d0-4a2b-9c86-3bfb0bdd7c9d/konnectivity-agent/0.log" Nov 02 14:21:16.448001 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:16.447974 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-60.us-east-2.compute.internal_85c2bb7358e6511a88ad994aa6c34739/haproxy/0.log" Nov 02 14:21:23.140650 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:23.140618 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-bxrxz_daa68537-3d04-4e70-adf0-ee7423c6442d/manager/0.log" Nov 02 14:21:23.176183 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:23.176151 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-g69sv_c5c3b940-2edd-4737-99a8-1906bde0b45d/manager/0.log" Nov 02 14:21:23.298129 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:23.298102 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-cwjw8_ac632b97-36f6-4e77-91f0-72e2ea7accb7/limitador/0.log" Nov 02 14:21:25.036699 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.036670 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-pnhbm_396ce5b5-d0e0-4200-8332-faed8c96a7ae/cluster-monitoring-operator/0.log" Nov 02 14:21:25.429399 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.429369 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2t8f_c84e5717-df90-411f-84dd-d82ba6155595/node-exporter/0.log" Nov 02 14:21:25.454692 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.454666 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2t8f_c84e5717-df90-411f-84dd-d82ba6155595/kube-rbac-proxy/0.log" Nov 02 14:21:25.479766 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.479740 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2t8f_c84e5717-df90-411f-84dd-d82ba6155595/init-textfile/0.log" Nov 02 14:21:25.681162 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.681079 5081 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck"] Nov 02 14:21:25.681637 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.681618 5081 cpu_manager.go:414] "containerMap: removing container" podUID="36cd288a-406f-4d92-9a3d-6c69b816d7ea" containerName="maas-api" Nov 02 14:21:25.681702 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.681640 5081 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36cd288a-406f-4d92-9a3d-6c69b816d7ea" containerName="maas-api" Nov 02 14:21:25.681787 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.681775 5081 memory_manager.go:365] "RemoveStaleState removing state" podUID="36cd288a-406f-4d92-9a3d-6c69b816d7ea" containerName="maas-api" Nov 02 14:21:25.685283 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.685262 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.696604 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.696574 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck"] Nov 02 14:21:25.782012 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.781973 5081 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g76p8\"/\"default-dockercfg-f4qh7\"" Nov 02 14:21:25.782204 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.782029 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g76p8\"/\"kube-root-ca.crt\"" Nov 02 14:21:25.782204 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.782029 5081 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g76p8\"/\"openshift-service-ca.crt\"" Nov 02 14:21:25.783519 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.783497 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-sys\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.783620 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.783564 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq698\" (UniqueName: \"kubernetes.io/projected/5f58be60-7e2a-47a5-8bf8-908c21b7f482-kube-api-access-dq698\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.783754 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.783715 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-lib-modules\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.783890 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.783768 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-proc\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.784002 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.783985 5081 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-podres\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.884877 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.884843 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-podres\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.884895 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-sys\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.884920 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq698\" (UniqueName: \"kubernetes.io/projected/5f58be60-7e2a-47a5-8bf8-908c21b7f482-kube-api-access-dq698\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.884958 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-lib-modules\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.884981 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-podres\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.884983 5081 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-proc\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.885040 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-proc\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.885009 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-sys\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.885058 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.885059 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5f58be60-7e2a-47a5-8bf8-908c21b7f482-lib-modules\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.897600 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.897574 5081 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq698\" (UniqueName: \"kubernetes.io/projected/5f58be60-7e2a-47a5-8bf8-908c21b7f482-kube-api-access-dq698\") pod \"perf-node-gather-daemonset-nzvck\" (UID: \"5f58be60-7e2a-47a5-8bf8-908c21b7f482\") " pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:25.911560 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.911504 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-x7snb_7dbc8c0e-a0c5-4a45-82b5-b299ac0da213/prometheus-operator-admission-webhook/0.log" Nov 02 14:21:25.999797 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:25.999699 5081 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:26.277832 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:26.277808 5081 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck"] Nov 02 14:21:26.279332 ip-10-0-134-60 kubenswrapper[5081]: W1102 14:21:26.279292 5081 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5f58be60_7e2a_47a5_8bf8_908c21b7f482.slice/crio-1fa2e34104863c47ba0c0e878359c06e4744c879fe62fb386304f44623e8a0c7 WatchSource:0}: Error finding container 1fa2e34104863c47ba0c0e878359c06e4744c879fe62fb386304f44623e8a0c7: Status 404 returned error can't find the container with id 1fa2e34104863c47ba0c0e878359c06e4744c879fe62fb386304f44623e8a0c7 Nov 02 14:21:26.298444 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:26.298411 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" event={"ID":"5f58be60-7e2a-47a5-8bf8-908c21b7f482","Type":"ContainerStarted","Data":"1fa2e34104863c47ba0c0e878359c06e4744c879fe62fb386304f44623e8a0c7"} Nov 02 14:21:27.305666 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:27.305629 5081 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" event={"ID":"5f58be60-7e2a-47a5-8bf8-908c21b7f482","Type":"ContainerStarted","Data":"0946544cc126b9c819a01b78c70c1d0a2ca3e2577fcffef51c45b19021dac1f7"} Nov 02 14:21:27.306123 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:27.305711 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:27.332891 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:27.332842 5081 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" podStartSLOduration=2.332828057 podStartE2EDuration="2.332828057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-02 14:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-02 14:21:27.331216586 +0000 UTC m=+2305.323604869" watchObservedRunningTime="2026-11-02 14:21:27.332828057 +0000 UTC m=+2305.325216341" Nov 02 14:21:27.358899 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:27.358868 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-62f4x_0108f6ec-1c16-4842-b63b-40b820bb1867/networking-console-plugin/0.log" Nov 02 14:21:28.067151 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:28.067120 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/1.log" Nov 02 14:21:28.071942 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:28.071905 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-h9df4_9f1e1f78-6650-47b7-bd32-33ff5e2ad398/console-operator/2.log" Nov 02 14:21:28.705379 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:28.705350 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-dh8qv_0fe2a38d-9948-4387-98de-892cb608ea8e/download-server/0.log" Nov 02 14:21:29.342900 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:29.342866 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-qw6f8_e6de1ad4-49f8-4b2a-b781-1339bcf825b7/volume-data-source-validator/0.log" Nov 02 14:21:30.699803 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:30.699776 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dntcg_dd231bc3-ed1b-4516-8327-05de58219655/dns/0.log" Nov 02 14:21:30.737652 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:30.737606 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dntcg_dd231bc3-ed1b-4516-8327-05de58219655/kube-rbac-proxy/0.log" Nov 02 14:21:30.828154 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:30.828125 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vgk6w_0817ddcd-6f81-4631-a580-bde045d0b712/dns-node-resolver/0.log" Nov 02 14:21:31.510301 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:31.510267 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-68cbf76f9-s86hn_4916b820-a289-4c96-bf86-d4d42a3a09ef/registry/0.log" Nov 02 14:21:31.573438 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:31.573409 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ks6n4_34ad0bf5-0de3-43dc-b13a-6ef480ff447f/node-ca/0.log" Nov 02 14:21:32.648014 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:32.647980 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5_864086cc-7ea5-4d29-9465-ded1c7d9b6ca/istio-proxy/0.log" Nov 02 14:21:33.323895 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:33.323866 5081 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g76p8/perf-node-gather-daemonset-nzvck" Nov 02 14:21:34.790846 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:34.790820 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/0.log" Nov 02 14:21:34.791773 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:34.791755 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/1.log" Nov 02 14:21:34.870627 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:34.870589 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-h78x6_7212b4c4-ccfc-495c-ba5b-1171ab72b7df/istio-proxy/0.log" Nov 02 14:21:35.029282 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:35.029252 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-n4k85_431cb77d-7b44-485d-93c8-9095ed1776f0/istio-proxy/0.log" Nov 02 14:21:35.063225 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:35.063147 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-rcdvr_e9a681d7-5f8e-43bb-9506-5fe18c312e7c/istio-proxy/0.log" Nov 02 14:21:35.094927 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:35.094903 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm_9b954ca7-cf83-4f27-8e11-4195ef387b3b/istio-proxy/0.log" Nov 02 14:21:35.211621 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:35.211597 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-744d4b8849-b5rwg_5c2be26f-f492-4cb0-a5f1-9840c4ff2437/router/0.log" Nov 02 14:21:36.529130 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:36.529094 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5_864086cc-7ea5-4d29-9465-ded1c7d9b6ca/istio-proxy/0.log" Nov 02 14:21:36.752777 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:36.752742 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5jl7s_b3d9d21b-0ce4-477e-acd2-a26f2e411b89/serve-healthcheck-canary/0.log" Nov 02 14:21:37.667199 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:37.667165 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-js5gg_020f9532-0954-430c-b455-024cc6e03be3/insights-operator/0.log" Nov 02 14:21:37.668183 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:37.668155 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-js5gg_020f9532-0954-430c-b455-024cc6e03be3/insights-operator/1.log" Nov 02 14:21:37.893752 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:37.893702 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k7fhx_8011c9f0-6ebd-4e37-8500-ebf56305e263/kube-rbac-proxy/0.log" Nov 02 14:21:37.922568 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:37.922476 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k7fhx_8011c9f0-6ebd-4e37-8500-ebf56305e263/exporter/0.log" Nov 02 14:21:37.950613 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:37.950587 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k7fhx_8011c9f0-6ebd-4e37-8500-ebf56305e263/extractor/0.log" Nov 02 14:21:37.990570 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:37.990521 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-k4db5-8k5kd_02d12b48-46f0-46df-9324-2efdbced83d7/insights-gathering/0.log" Nov 02 14:21:38.444230 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:38.444204 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/0.log" Nov 02 14:21:38.445110 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:38.445067 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/1.log" Nov 02 14:21:38.483627 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:38.483601 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-h78x6_7212b4c4-ccfc-495c-ba5b-1171ab72b7df/istio-proxy/0.log" Nov 02 14:21:38.556258 ip-10-0-134-60 kubenswrapper[5081]: E1102 14:21:38.556214 5081 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-k7fhx" containerName="extractor" Nov 02 14:21:38.564295 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:38.564262 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-n4k85_431cb77d-7b44-485d-93c8-9095ed1776f0/istio-proxy/0.log" Nov 02 14:21:38.584177 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:38.584151 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-rcdvr_e9a681d7-5f8e-43bb-9506-5fe18c312e7c/istio-proxy/0.log" Nov 02 14:21:38.606658 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:38.606629 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-77b95bc695-kmwbm_9b954ca7-cf83-4f27-8e11-4195ef387b3b/istio-proxy/0.log" Nov 02 14:21:38.664168 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:38.664139 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-744d4b8849-b5rwg_5c2be26f-f492-4cb0-a5f1-9840c4ff2437/router/0.log" Nov 02 14:21:40.466758 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:40.466723 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-c559bd947-bzwc9_9ba634ce-29a2-4aa7-9446-25f7ab4dcb29/manager/0.log" Nov 02 14:21:40.510041 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:40.510015 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-c559bd947-bzwc9_9ba634ce-29a2-4aa7-9446-25f7ab4dcb29/copy-manifests/0.log" Nov 02 14:21:40.527781 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:40.527754 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-67b5c995fc6nhz5_864086cc-7ea5-4d29-9465-ded1c7d9b6ca/istio-proxy/0.log" Nov 02 14:21:42.390589 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:42.390558 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/0.log" Nov 02 14:21:42.391610 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:42.391588 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-dlq49_10357ae6-63df-4967-8cc0-537b1e787d13/istio-proxy/1.log" Nov 02 14:21:42.441683 ip-10-0-134-60 kubenswrapper[5081]: I1102 14:21:42.441656 5081 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8b64f9ff9-h78x6_7212b4c4-ccfc-495c-ba5b-1171ab72b7df/istio-proxy/0.log"